HistoryServerArguments is the command-line parser for the History Server.
HistoryServerArguments is executed with a single command-line parameter it is assumed to be the event logs directory.
$ ./sbin/start-history-server.sh /tmp/spark-events
This is however deprecated since Spark 1.1.0 and you should see the following WARN message in the logs:
WARN HistoryServerArguments: Setting log directory through the command line is deprecated as of Spark 1.1.0. Please set this through spark.history.fs.logDirectory instead.
The same WARN message shows up for
-d command-line options.
--properties-file [propertiesFile] command-line option specifies the file with the custom Spark properties.
|When not specified explicitly, History Server uses the default configuration file, i.e. spark-defaults.conf.|
Add the following line to
Refer to Logging.