AI/ML Data Scientist for Reliability & Chaos Engineering

Remote

San Francisco (CA)

Remote

USD 220,000 - 290,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Gremlin is seeking a Data Scientist, AI/ML to turn chaos engineering data into automated failure analysis and remediation, improving reliability for customers from Fortune 500 to SMB. You will work with a small, skilled team to ship AI-driven features that enhance product quality and resilience.

In this role, you’ll develop models, build data pipelines, and collaborate with SREs to integrate AI capabilities into Gremlin’s platform.

Qualifications

  • Experience as a self-driven and collaborative problem solver with strong communication skills.
  • 5+ years professional experience building and productionizing machine learning, ideally for distributed systems, infrastructure, or DevOps and SRE use cases with more overall years of experience in software development.
  • Hands-on experience with causal inference, graph ML, time-series modeling, or reinforcement learning.
  • Experience building data pipelines and feature stores that support offline training and real-time inference.
  • Experience with agile development environments and practices.
  • Strong advocate and practitioner of rigorous experimentation, model evaluation, and engineering best practices.
  • Comfort partnering with platform engineers and SREs to turn research into shipped product features.
  • Strong at breaking down ambiguous problems into concrete actions and milestones.

Responsibilities

  • Analyze Gremlin’s proprietary dataset of millions of chaos engineering experiments to identify failure patterns, root causes, and resilience signals across complex distributed systems.
  • Pretraining and fine-tuning machine learning models that automatically detect, classify, and explain failures observed during chaos experiments.
  • Build intelligent systems that deliver automated remediation recommendations, and eventually orchestration, by learning from historical experiment outcomes and system behavior.
  • Develop scalable data pipelines and feature stores to process, enrich, and serve large volumes of experiment data for both model training and real-time inference.
  • Collaborate closely with platform engineers and SREs to integrate AI-driven failure analysis and remediation capabilities directly into Gremlin’s core product.
  • Apply advanced techniques, including causal inference, graph ML, time-series modeling, and reinforcement learning, to continuously improve the accuracy and actionability of automated failure analysis.
  • Translate insights from millions of chaos experiments into AI-powered features that help customers automatically understand blast radius, pinpoint root causes, and accelerate recovery.
  • Research and productionize novel ML approaches, including causal AI and agentic systems, that turn raw chaos experiment data into automated, reliable remediation strategies.

Skills

Problem solving
Communication
Machine learning
Distributed systems
Experimentation
Model evaluation
Collaboration
Breaking down problems

Job description

Gremlin is seeking a Data Scientist, AI/ML to turn chaos engineering data into automated failure analysis and remediation, improving reliability for customers from Fortune 500 to SMB. You will work with a small, skilled team to ship AI-driven features that enhance product quality and resilience.

In this role, you’ll develop models, build data pipelines, and collaborate with SREs to integrate AI capabilities into Gremlin’s platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI/ML Data Scientist for Chaos Reliability (Remote)
AI/ML Data Scientist for Chaos Reliability (Remote)

Gremlin • United States

Remote
USD 220,000 - 290,000
401k Matching
Equity
Paid company holidays
+1
Data Scientist, AI/ML
Data Scientist, AI/ML

Remote • San Francisco (CA)

Remote
USD 220,000 - 290,000
Senior Chaos-Engineering Backend Engineer
Senior Chaos-Engineering Backend Engineer

Gremlin • Indiana (PA)

Remote
USD 220,000 - 290,000
401k Matching
Equity
Flexible time off
+1
Senior Backend Engineer: Chaos & Reliability Tools (Remote)
Senior Backend Engineer: Chaos & Reliability Tools (Remote)

Devconnectplatform • United States

Remote
USD 220,000 - 290,000
401k Matching
Equity
Flexible time off
+1
Reliability Solutions Architect — Pre/Post Sales
Reliability Solutions Architect — Pre/Post Sales

Gremlin • Indiana (PA)

On-site
USD 90,000 - 120,000
Senior B2B SaaS Content Marketing Manager | AI/SEO Lead
Senior B2B SaaS Content Marketing Manager | AI/SEO Lead

Gremlin • United States

Remote
USD 145,000 - 165,000
401k Matching
Equity
Flexible time off
+1
Senior AI Infrastructure Reliability Engineer
Senior AI Infrastructure Reliability Engineer

Fireworks • San Mateo (CA)

On-site
USD 190,000 - 270,000
Senior AI/ML Engineer | Data Science
Senior AI/ML Engineer | Data Science

Tech in Motion • Dallas (TX)

On-site
USD 140,000 - 190,000
Sr. Site Reliability Engineer
Sr. Site Reliability Engineer

Tiger Analytics • Washington

Hybrid
USD 120,000 - 160,000
Career development opportunities
Senior AI Architect & Modeling Lead
Senior AI Architect & Modeling Lead

Creative Chaos • San Francisco (CA)

On-site
USD 140,000 - 210,000