Step by Step guide to expose spark jmx metrics and funnel them to datadog.

Aditya
2 min readNov 4, 2022

Please read my previous article https://sprinkle-twinkles.medium.com/how-jmx-metrics-from-spark-applications-will-help-to-configure-driver-executor-memory-correctly-560d5863d0af article to get context around the need and use of exposing spark jmx metrics .

Below are steps we need follow to expose spark jmx metrics and export them to datadog.

Step one: Configure spark job to expose jmx metrics.

--

--

Aditya

Principal data engineer → Distributed Threat hunting security platform | aws certified solutions architect | gssp-java | Chicago-IL