3.5.0
Jobs
Stages
Storage
Environment
Executors
SQL / DataFrame
Structured Streaming
mc-data-pipeline
application UI
Details for Stage 387 (Attempt 0)
Resource Profile Id:
0
Total Time Across All Tasks:
3 ms
Locality Level Summary:
Process local: 2
Input Size / Records:
0.0 B / 6
Associated Job Ids:
387
DAG Visualization
digraph G { subgraph clusterstage_387 { label="Stage 387"; 1547 [labelType="html" label="SQLExecutionRDD [1547]<br>start at KafkaDataFrameDataSource.scala:46"]; subgraph cluster4249 { label="MicroBatchScan"; 1544 [labelType="html" label="DataSourceRDD [1544]<br>start at KafkaDataFrameDataSource.scala:46"]; 1545 [labelType="html" label="MapPartitionsRDD [1545]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster4246 { label="WholeStageCodegen (1)"; 1546 [labelType="html" label="MapPartitionsRDD [1546]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster4260 { label="WholeStageCodegen (1)"; 1550 [labelType="html" label="MapPartitionsRDD [1550]<br>start at KafkaDataFrameDataSource.scala:46"]; } subgraph cluster4263 { label="mapPartitionsInternal"; 1551 [labelType="html" label="MapPartitionsRDD [1551]<br>start at KafkaDataFrameDataSource.scala:46"]; } } 1544->1545; 1545->1546; 1546->1547; 1547->1550; 1550->1551; }
Event Timeline
Enable zooming
Tasks: 2. 1 Pages. Jump to
. Show
items in a page.
Go
Scheduler Delay
Task Deserialization Time
Shuffle Read Time
Executor Computing Time
Shuffle Write Time
Result Serialization Time
Getting Result Time