ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

Orca: add dashboard.log error in known issue (#4943)

Browse source 
* add dashboard.log error

* add title

* typo fix
This commit is contained in:
Junwei Deng 2022-06-27 11:10:24 +08:00 committed by GitHub
parent 86fa1c02ab
commit 76608a5034
1 changed files with 21 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

22
docs/readthedocs/source/doc/Orca/Overview/known_issues.md
View file

@ -18,4 +18,24 @@ You could follow below steps:
If you are using `init_orca_context(cluster_mode="spark-submit")`: If you are using `init_orca_context(cluster_mode="spark-submit")`:
``` ```
spark-submit --conf "spark.executorEnv.ARROW_LIBHDFS_DIR=/opt/cloudera/parcels/CDH-5.15.2-1.cdh5.15.2.p0.3/lib64" spark-submit --conf "spark.executorEnv.ARROW_LIBHDFS_DIR=/opt/cloudera/parcels/CDH-5.15.2-1.cdh5.15.2.p0.3/lib64"
``` ```
## **Orca Context Issues**
### **Exception: Failed to read dashbord log: [Errno 2] No such file or directory: '/tmp/ray/.../dashboard.log'**
This error occurs when initialize an orca context with `init_ray_on_spark=True`. We have not locate the root cause of this problem, but it might be caused by an atypical python environment.
You could follow below steps to workaround:
1. If you only need to use functions in ray (e.g. `bigdl.orca.learn` with `backend="ray"`, `bigdl.orca.automl` for pytorch/tensorflow model, `bigdl.chronos.autots` for time series model's auto-tunning), we may use ray as the first-class.
1. Start a ray cluster by `ray start --head`. if you already have a ray cluster started, please direcetly jump to step 2.
2. Initialize an orca context with `runtime="ray"` and `init_ray_on_spark=False`, please refer to detailed information [here](./orca-context.html).
3. If you are using `bigdl.orca.automl` or `bigdl.chronos.autots` on a single node, please set:
```python
ray_ctx = OrcaContext.get_ray_context()
ray_ctx.is_local=True
```
2. If you really need to use ray on spark, please install bigdl-orca under a conda environment. Detailed information please refer to [here](./orca.html).