| Stage Id ▾ | Description | Submitted | Duration | Tasks: Succeeded/Total | Input | Output | Shuffle Read | Shuffle Write |
|---|---|---|---|---|---|---|---|---|
| 0 | Spark Connect - session_id: "58d45445-3af3-4104-9739-56b4041ec0f9"
plan {
root {
common {
plan_id: 1
}
aggregate {
... Spark Connect - session_id: "58d45445-3af3-4104-9739-56b4041ec0f9"
plan {
root {
common {
plan_id: 1
}
aggregate {
... session_id: "58d45445-3af3-4104-9739-56b4041ec0f9"
plan {
root {
common {
plan_id: 1
}
aggregate {
input {
common {
plan_id: 0
}
read {
data_source {
format: "parquet"
schema: ""
paths: "/home/jovyan/Inbound/fhvhv_tripdata_2025-01.parquet"
}
}
}
group_type: GROUP_TYPE_GROUPBY
aggregate_expressions {
unresolved_function {
function_name: "count"
arguments {
literal {
integer: 1
}
}
}
}
}
}
}
client_type: "_SPARK_CONNECT_PYTHON spark/3.5.3 os/linux python/3.11.10"
request_options {
reattach_options {
reattachable: true
}
}
operation_id: "c34a7a0d-1c5e-40c5-9382-bff2029654d0"
| 2026/07/20 19:28:23 | 1 s |
1/1
|