Step by Step guide to expose spark jmx metrics and funnel them to datadog.
Please read my previous article https://sprinkle-twinkles.medium.com/how-jmx-metrics-from-spark-applications-will-help-to-configure-driver-executor-memory-correctly-560d5863d0af article to get context around the need and use of exposing spark jmx metrics .
Below are steps we need follow to expose spark jmx metrics and export them to datadog.
Step one: Configure spark job to expose jmx metrics.