Web UI — Spark Application’s Web Console

Web UI (aka Application UI or webUI or Spark UI) is the web interface of a Spark application to monitor and inspect Spark jobs in a web browser.

spark webui jobs
Figure 1. Welcome Page of web UI — Jobs Tab

Every Spark application (SparkContext) starts a web UI that is available at http://[driverHostname]:4040 by default.

The default port can be changed using spark.ui.port configuration property. SparkContext will increase the port if it is already taken until a free one is found.

web UI comes with the following tabs (pages):

You can use the web UI after the application has finished by persisting events (using EventLoggingListener) and using Spark History Server.
All the information that is displayed in web UI is available thanks to JobProgressListener and other SparkListeners. One could say that web UI is a web layer over Spark listeners.