ayo/ipex-llm
1
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions 1

change engine's required configuration to warning (#3366)

Browse source 
* change engine's error to warning

* delete spark.shuffle.reduceLocality.enabled

* Update test_spark-bigdl.conf

* Update EngineSpec.scala

* Update test_zoo_utils.py

* Update test_image3d.py

* Update AnalyticsZoo-on-Databricks.md

* Update databricks.md

* Update test_zoo_utils.py
This commit is contained in:
Xin Qiu 2021-11-03 09:35:37 +08:00 committed by GitHub
parent f185a608ce
commit 17060f541a
1 changed files with 0 additions and 1 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

1
docs/readthedocs/source/doc/UserGuide/databricks.md
View file

@ -51,7 +51,6 @@ On the cluster configuration page, click the **Advanced Options** toggle. Click
See below for an example of Spark config setting needed by BigDL. Here it sets 2 core per executor. Note that "spark.cores.max" needs to be properly set below. See below for an example of Spark config setting needed by BigDL. Here it sets 2 core per executor. Note that "spark.cores.max" needs to be properly set below.
``` ```
spark.shuffle.reduceLocality.enabled false
spark.serializer org.apache.spark.serializer.JavaSerializer spark.serializer org.apache.spark.serializer.JavaSerializer
spark.shuffle.blockTransferService nio spark.shuffle.blockTransferService nio
spark.databricks.delta.preview.enabled true spark.databricks.delta.preview.enabled true