Senior ML Safeguards Engineer (Remote)

Moveworks; Mountain View (CA); Remote; USD 180,000 - 260,000; Full time

Job summary

Moveworks is seeking an experienced software and ML engineer to design, build and ship safeguards for large language models in production. You’ll work with the Security team to turn adversarial findings into robust evals and mitigations across a shared stack used in commercial and government environments.

You have 8+ years in production software, 3+ years in applied ML, and deep Python expertise to evaluate model behavior, detect jailbreaks, and protect data.

Qualifications

• Typically 8 or more years building production software, including 3 or more years of applied ML (training, evaluating and deploying models in production systems)
• Hands-on experience developing safeguards for LLMs, such as guardrail models, content classifiers, prompt injection or jailbreak detection, or safety evals
• Strong model evaluation fundamentals for agent trajectories and text classification, and attention to the quality of training and evaluation data
• Working knowledge of how LLM safeguards get bypassed, including indirect prompt injection through tools and documents, and multi-turn jailbreaks
• Excellent Python Experience

Responsibilities

• Design, build and ship safeguards in the agent harness for prompt injection, single and multi-turn jailbreaks, toxicity and sensitive topics, and sensitive data exposure
• Build evals that measure safeguard efficacy on both false and true positives, using datasets from customer reports, adversarial testing and production traffic
• Work closely with our Security team: turn their adversarial findings into eval cases and fixes, and build mitigations together that hold when detection misses
• Select, integrate and fine-tune detection models within a stack shared by our commercial and government environments
• Balance quality, latency and cost for controls that run in the request path
• Build configurable safeguard policies so customers can decide how sensitive topics are handled
• Monitor safeguard behavior in production and fix regressions

Skills

Production software

Applied ML

Python

Tools

Python

LLM safeguards

Job description

Moveworks is seeking an experienced software and ML engineer to design, build and ship safeguards for large language models in production. You’ll work with the Security team to turn adversarial findings into robust evals and mitigations across a shared stack used in commercial and government environments.

You have 8+ years in production software, 3+ years in applied ML, and deep Python expertise to evaluate model behavior, detect jailbreaks, and protect data.