Senior Data Engineer — Billing & Data Pipelines Lead

Datadog; Boston (MA); Hybrid; USD 192,000 - 240,000; Full time

Benefits offered by this job

Equity package

Healthcare

401(k) plan and match

Paid time off

Mental health benefits

Job summary

Datadog is seeking a Senior Software Engineer to own parts of a large-scale data processing platform, focusing on billing and cost attribution for Datadog products.

You will design high-throughput data pipelines with Spark and Airflow, work in Python and Scala, and drive improvements in latency, reliability, and billing accuracy across cross-functional teams.

Hybrid in Boston, with on-call rotation and opportunities to influence engineering standards and culture.

Qualifications

• Experience building and operating production data pipelines at scale using Spark and Airflow.
• Comfortable owning complex, cross-functional investigations and driving them to resolution.
• Balance feature delivery with platform health and technical debt.

Responsibilities

• Design and build high-throughput data pipelines for billing and cost attribution.
• Drive platform improvements—latency reduction, Spark optimization, sharding, and cross-datacenter reliability.
• Own root‑cause investigations on billing accuracy issues in collaboration with Finance and Product teams.
• Contribute to new billing features.
• Work across Python and Scala, with Spark, Airflow, Trino, and Apache Iceberg.
• Participate in on‑call rotation and maintain a high reliability bar for production systems.
• Contribute to engineering standards and help grow the technical culture of the team.

Skills

Spark

Airflow

Python/Scala

Data pipelines

On-call rotation

Tools

Trino

Apache Iceberg

Spark

Airflow

Job description

Datadog is seeking a Senior Software Engineer to own parts of a large-scale data processing platform, focusing on billing and cost attribution for Datadog products.

You will design high-throughput data pipelines with Spark and Airflow, work in Python and Scala, and drive improvements in latency, reliability, and billing accuracy across cross-functional teams.

Hybrid in Boston, with on-call rotation and opportunities to influence engineering standards and culture.