Senior Data Engineer - Revenue Data Platform

Datadog; Boston (MA); Hybrid; USD 192,000 - 240,000; Full time

Benefits offered by this job

Equity package

Healthcare

401(k) plan and match

Paid time off

Mental health benefits

Job summary

Datadog is seeking a Senior Software Engineer to own parts of a large-scale data processing platform, focusing on billing and cost attribution for Datadog products.

You will design high-throughput data pipelines with Spark and Airflow, work in Python and Scala, and drive improvements in latency, reliability, and billing accuracy across cross-functional teams.

Hybrid in Boston, with on-call rotation and opportunities to influence engineering standards and culture.

Qualifications

• Experience building and operating production data pipelines at scale using Spark and Airflow.
• Comfortable owning complex, cross-functional investigations and driving them to resolution.
• Balance feature delivery with platform health and technical debt.

Responsibilities

• Design and build high-throughput data pipelines for billing and cost attribution.
• Drive platform improvements—latency reduction, Spark optimization, sharding, and cross-datacenter reliability.
• Own root‑cause investigations on billing accuracy issues in collaboration with Finance and Product teams.
• Contribute to new billing features.
• Work across Python and Scala, with Spark, Airflow, Trino, and Apache Iceberg.
• Participate in on‑call rotation and maintain a high reliability bar for production systems.
• Contribute to engineering standards and help grow the technical culture of the team.

Skills

Spark

Airflow

Python/Scala

Data pipelines

On-call rotation

Tools

Trino

Apache Iceberg

Spark

Airflow

Job description

About Datadog:

We're on a mission to build the best platform in the world for engineers to understand and scale their systems, applications, and teams. We operate at high scale—trillions of data points per day—allowing for seamless collaboration and problem-solving among Dev, Ops and Security teams globally for tens of thousands of companies. Our engineering culture values pragmatism, honesty, and simplicity to solve hard problems the right way.

The Team:

The Revenue Data Engineering Teams designs, builds and runs the data pipelines and helper systems to accurately and in a timely manner quantify our customers’ usage across all Datadog products. This team is at the leading edge of any new product we release.

The Revenue Data Processing team builds and operates the data pipelines that does billing, and cost attribution for all Datadog products. We process terabytes of data daily to power revenue‑critical systems and are at the center of every new product launch at Datadog.

As a Senior Software Engineer, you will own meaningful parts of a large-scale, mission‑critical processing platform — driving architectural improvements, building new billing capabilities, and maintaining the high reliability bar our downstream consumers depend on.

You Will:

1. Design and build high-throughput data pipelines for billing and cost attribution
2. Drive platform improvements — latency reduction, Spark optimization, sharding, and cross-datacenter reliability
3. Own root‑cause investigations on billing accuracy issues in collaboration with Finance and Product teams
4. Contribute to new billing features
5. Work across Python and Scala, with technologies including Spark, Airflow, Trino, and Apache Iceberg
6. Participate in on‑call rotation and maintain a high reliability bar for production systems
7. Contribute to engineering standards and help grow the technical culture of the team

You Are:

• You have significant experience building and operating production data pipelines at scale using Spark and Airflow
• You are comfortable owning complex, cross-functional investigations and driving them to resolution
• You understand how to balance feature delivery with platform health and technical debt
• You have strong analytical instincts and are rigorous about correctness in data systems
• You work well in ambiguous environments and can drive alignment across stakeholder teams
• You care about code quality, maintainability, and operational excellence

Bonus Points:

• Have experience with Apache Iceberg or Lakehouse architectures
• Have worked on billing, metering, or financial data systems
• Have experience with low‑latency data serving or real‑time aggregation pipelines

To conform to US export control regulations, candidates should be eligible for any required authorizations from the US government. This job is available in various departments within our company; to conform to US export control regulations, some of these roles may require candidates to be eligible for any required authorizations from the US government.

#LI-Hybrid

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is: $192,000 — $240,000 USD

About Datadog:

Datadog is the leading observability and security platform for the AI era, providing businesses with unified visibility across the technology stack to manage complexity at scale. It brings applications, infrastructure, data, models, and security into one place, using AI to detect and resolve issues before they impact customers. Trusted globally by Fortune 500 companies and high-growth AI leaders, Datadog enables businesses to move faster with clarity and confidence. Learn more about #DatadogLife on Instagram, LinkedIn, and Datadog Learning Center.

Equal Opportunity at Datadog:

Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.

Datadog endeavors to make our Careers Page accessible to all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please complete this form. This form is for accommodation requests only and cannot be used to inquire about the status of applications.

Privacy and AI Guidelines:

Any information you submit to Datadog as part of your application will be processed in accordance with Datadog’s Applicant and Candidate Privacy Notice. For information on our AI policy, please visit Interviewing at Datadog AI Guidelines.