Web UI — Spark Application’s Web Console
Web UI (aka Application UI or webUI or Spark UI) is the web interface of a Spark application to monitor and inspect Spark job executions in a web browser.
Every time you create a
SparkContext in a Spark application you also launch an instance of web UI. The web UI is available at
http://[driverHostname]:4040 by default.
The default port can be changed using spark.ui.port configuration property.
web UI comes with the following tabs (which may not all be visible immediately, but only after the respective modules are in use, e.g. the SQL or Streaming tabs):
|You can use the web UI after the application has finished by persisting events (using EventLoggingListener) and using Spark History Server.|