diff --git a/docs/readthedocs/source/doc/UserGuide/databricks.md b/docs/readthedocs/source/doc/UserGuide/databricks.md index 32c13e8d..642b59ab 100644 --- a/docs/readthedocs/source/doc/UserGuide/databricks.md +++ b/docs/readthedocs/source/doc/UserGuide/databricks.md @@ -51,14 +51,7 @@ On the cluster configuration page, click the **Advanced Options** toggle. Click See below for an example of Spark config setting needed by BigDL. Here it sets 2 core per executor. Note that "spark.cores.max" needs to be properly set below. ``` -spark.shuffle.reduceLocality.enabled false -spark.serializer org.apache.spark.serializer.JavaSerializer -spark.shuffle.blockTransferService nio -spark.databricks.delta.preview.enabled true spark.executor.cores 2 -spark.speculation false -spark.scheduler.minRegisteredResourcesRatio 1.0 -spark.scheduler.maxRegisteredResourcesWaitingTime 3600s spark.cores.max 4 ```