AI/ML Data Scientist for Reliability & Chaos Engineering

Gremlin; United States; Remote; USD 220,000 - 290,000; Full time

Benefits offered by this job

401k Matching

Equity

Paid time off

Job summary

Gremlin is seeking a Data Scientist, AI/ML to convert millions of chaos experiments into automated failure analysis and remediation. You will apply ML to guide product direction and solve complex problems that affect our customers, from Fortune 500 firms to smaller teams.

You’ll collaborate with a small, high‑caliber engineering team focused on reliability, quality, delivery, and user experience. Build scalable data pipelines and feature stores to support training and real‑time inference, and

Qualifications

• Experience as a self‑driven and collaborative problem solver with strong communication skills.
• 5+ years professional experience building and productionizing machine learning, ideally for distributed systems, infrastructure, or DevOps/SRE.
• Hands-on experience with causal inference, graph ML, time-series modeling, or reinforcement learning.
• Experience building data pipelines and feature stores supporting offline training and real-time inference.
• Experience with agile development environments and practices.
• Strong advocate and practitioner of rigorous experimentation, model evaluation, and engineering best practices.
• Comfort partnering with platform engineers and SREs to turn research into shipped product features.

Responsibilities

• Analyze Gremlin’s dataset of chaos experiments to identify failure patterns and resilience signals.
• Pretrain and fine-tune ML models that detect, classify, and explain failures observed during chaos experiments.
• Build intelligent systems delivering automated remediation recommendations and orchestration.
• Develop scalable data pipelines and feature stores for model training and real-time inference.
• Collaborate with platform engineers and SREs to integrate AI-driven failure analysis into the core product.
• Apply techniques including causal inference, graph ML, time-series modeling, and RL to improve accuracy and actionability.
• Translate insights into AI-powered features to help customers understand blast radius and root causes.

Skills

Self-driven problem solver

Collaboration

Machine Learning

Distributed systems

SRE collaboration

Experimentation

Communication skills

Tools

Model serving

Feature store

MLOps tooling

Graph ML frameworks

Job description

Gremlin is seeking a Data Scientist, AI/ML to convert millions of chaos experiments into automated failure analysis and remediation. You will apply ML to guide product direction and solve complex problems that affect our customers, from Fortune 500 firms to smaller teams.

You’ll collaborate with a small, high‑caliber engineering team focused on reliability, quality, delivery, and user experience. Build scalable data pipelines and feature stores to support training and real‑time inference, and