From db2818c8f766580a5c4cedea19942f2fd2b5670e Mon Sep 17 00:00:00 2001 From: Le-Zheng <30695225+Le-Zheng@users.noreply.github.com> Date: Thu, 26 May 2022 07:41:44 +0800 Subject: [PATCH] update databrciks doc (#4691) --- docs/readthedocs/source/doc/UserGuide/databricks.md | 7 ------- 1 file changed, 7 deletions(-) diff --git a/docs/readthedocs/source/doc/UserGuide/databricks.md b/docs/readthedocs/source/doc/UserGuide/databricks.md index 32c13e8d..642b59ab 100644 --- a/docs/readthedocs/source/doc/UserGuide/databricks.md +++ b/docs/readthedocs/source/doc/UserGuide/databricks.md @@ -51,14 +51,7 @@ On the cluster configuration page, click the **Advanced Options** toggle. Click See below for an example of Spark config setting needed by BigDL. Here it sets 2 core per executor. Note that "spark.cores.max" needs to be properly set below. ``` -spark.shuffle.reduceLocality.enabled false -spark.serializer org.apache.spark.serializer.JavaSerializer -spark.shuffle.blockTransferService nio -spark.databricks.delta.preview.enabled true spark.executor.cores 2 -spark.speculation false -spark.scheduler.minRegisteredResourcesRatio 1.0 -spark.scheduler.maxRegisteredResourcesWaitingTime 3600s spark.cores.max 4 ```