ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

update databrciks doc (#4691)

Browse source
This commit is contained in:
Le-Zheng 2022-05-26 07:41:44 +08:00 committed by GitHub
parent 55fa3e13e6
commit db2818c8f7
1 changed files with 0 additions and 7 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

7
docs/readthedocs/source/doc/UserGuide/databricks.md
View file

@ -51,14 +51,7 @@ On the cluster configuration page, click the **Advanced Options** toggle. Click
See below for an example of Spark config setting needed by BigDL. Here it sets 2 core per executor. Note that "spark.cores.max" needs to be properly set below.
```
spark.shuffle.reduceLocality.enabled false
spark.serializer org.apache.spark.serializer.JavaSerializer
spark.shuffle.blockTransferService nio
spark.databricks.delta.preview.enabled true
spark.executor.cores 2
spark.speculation false
spark.scheduler.minRegisteredResourcesRatio 1.0
spark.scheduler.maxRegisteredResourcesWaitingTime 3600s
spark.cores.max 4
```