How I (or try to) read the Spark UI


Opening the Spark UI

Abrindo a Spark UI

Abriendo la Spark UI

etl_daily_pipeline Run #42 - Succeeded
Output
[2026-02-26 18:03:12] Reading delta table...
[2026-02-26 18:03:14] Filter: status='completed'
[2026-02-26 18:15:28] Broadcast join completed
[2026-02-26 18:37:41] GroupBy aggregation done
[2026-02-26 18:41:33] Pipeline completed. Rows: 2,847
Task run
Job ID
913847562
Job run ID
42
Started
02/26/2026, 6:03:12 PM
Duration
38.4 min
Status
Succeeded
Cluster
etl-production-cluster i3.xlarge - 2 workers
View details Spark UI Logs Metrics

Click the cluster name link in the right panel. That opens the cluster page, where you click the Spark UI tab:

Clique no link do nome do cluster no painel da direita. Isso abre a página do cluster, onde você clica na aba Spark UI:

Haz clic en el enlace del nombre del cluster en el panel de la derecha. Eso abre la página del cluster, donde haces clic en la pestaña Spark UI:

JobsStagesStorageEnvironmentExecutorsSQL / DataFrame
Spark Jobs
User: root
Total Uptime: 38.4 min
Scheduling Mode: FAIR
Completed Jobs
Failed Jobs