Staff GenAI Engineer - Application Performance Monitoring (APM)

Datadog; New York (NY); On-site; USD 234,000 - 300,000; Full time

Benefits offered by this job

competitive salary

healthcare benefits

401(k) plan and match

paid time off

Job summary

I did my part and supported the Regular Toilet is seeking a Staff Software Engineer with deep experience in GenAI/ML to join their Application Performance Monitoring team. As a technical leader, you will drive GenAI/machine learning projects and influence product direction through collaboration and mentoring.

The ideal candidate must have a BS/MS/PhD in a scientific field, over 10 years of relevant engineering experience, and a proven record in leading large-scale initiatives. This is a hybrid role offering competitive salary and benefits.

Qualifications

• 10+ years of relevant engineering experience.
• Experience acting as a technical lead.
• Proven track record of leading large-scale GenAI/ML initiatives.

Responsibilities

• Act as a technical leader within the APM organization.
• Build and benchmark GenAI/ML models.
• Collaborate with cross-functional teams.

Skills

GenAI/ML

leadership

collaboration

communication skills

Education

BS/MS/PhD in a scientific field or equivalent experience

Job description

We’re looking for a Staff Software Engineer with deep experience in GenAI/ML to join Datadog’s Application Performance Monitoring (APM) team. APM is a product which provides deep visibility into applications, enabling users to identify performance bottlenecks, troubleshoot issues, and optimize services. With distributed tracing, profiling, out-of-the-box dashboards, and seamless correlation with other telemetry data, Datadog APM provides some of the deepest and most structured visibility into the health and performance of applications. This context sets us up for an opportunity to be the world leaders in agentic investigations and incident troubleshooting.

You’ll act as a technical leader within the APM group, focused on agentic workflows. You’ll lead efforts to design, train, evaluate, and deploy GenAI/ML models at scale. We’re looking for a product-minded ML engineer with strong technical expertise, excellent communication skills, and a track record of driving impactful initiatives end to end.

At Datadog, we place value in our office culture - the relationships and collaboration it builds and the creativity it brings to the table. We operate as a hybrid workplace to ensure our Datadogs can create a work-life harmony that best fits them.

What You’ll Do

• Act as a technical leader within the APM organization, driving GenAI/machine learning projects from concept to production.
• Build and benchmark GenAI/ML models using state-of-the-art techniques.
• Collaborate with cross-functional teams to build automated investigation and triaging tools.
• Influence product direction by bringing a strong product mindset to your work, always advocating for the end user.
• Guide teams through ambiguity, scaling challenges, and evolving requirements with clear technical direction.
• Actively mentor engineers and influence engineering culture through leadership in design reviews, technical talks, and working groups.

Who You Are

• You have a BS/MS/PhD in a scientific field or equivalent experience
• 10+ years of relevant engineering experience, as well as experience acting as a technical lead
• Proven track record of leading large-scale GenAI/ML initiatives in a product-driven environment
• You have significant experience in model deployment, development, training, fine-tuning, or evaluation
• Ability to drive initiatives across cross-functional teams, and solve ambiguous challenges

Benefits and Growth

• Get to build tools for software engineers, just like yourself. And use the tools we build to accelerate our development.
• Have a lot of influence on product direction and impact on the business.
• Work with skilled, knowledgeable, and kind teammates who are happy to teach and learn
• Competitive global benefits
• Continuous professional development

Datadog offers a competitive salary and equity package, and may include variable compensation. Actual compensation is based on factors such as the candidate's skills, qualifications, and experience. In addition, Datadog offers a wide range of best in class, comprehensive and inclusive employee benefits for this role including healthcare, dental, parental planning, and mental health benefits, a 401(k) plan and match, paid time off, fitness reimbursements, and a discounted employee stock purchase plan.

The reasonably estimated yearly salary for this role at Datadog is: $234,000 — $300,000 USD

Equal Opportunity at Datadog

Datadog is proud to offer equal employment opportunity to everyone regardless of race, color, ancestry, religion, sex, national origin, sexual orientation, age, citizenship, marital status, disability, gender identity, veteran status, and other characteristics protected by law. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. Here are our Candidate Legal Notices for your reference.