I noticed that this error is fixed:
Allow users to disable the Jetty Spark interface in local modehttps://issues.apache.org/jira/browse/SPARK-2100
Allow users to disable the Jetty Spark interface in local mode
https://issues.apache.org/jira/browse/SPARK-2100
but how can it be disabled programmatically?
- this is
sparkContext.setLocalProperty(?, ?)
I checked the documentation but could not determine which property to set
http://spark.apache.org/docs/latest/configuration.html#spark-ui
Set spark.ui.enabled to false . This configuration is not documented on the Spark configuration page, as it was added as an internal configuration for debugging and unit tests [1].
spark.ui.enabled
false
[1] https://github.com/apache/spark/pull/2363/files#r17436782