Staff ML Engineer, Agentic AI — Build Trusted Agents

Unchain Data; Menlo Park (CA); On-site; USD 255,000 - 300,000; Full time

Benefits offered by this job

Health insurance

Equity

401(k) matching

Wellness benefits

Life & disability insurance

Paid time off

Job summary

Robinhood seeks a Staff Machine Learning Engineer (IC6) to define and uphold the quality bar for agentic systems across the organization. You will design evaluation frameworks, guide model selection, and partner with product, data science, and engineering teams to ensure systems meet standards for correctness, safety, latency, and user satisfaction.

Based in Bellevue, WA or Menlo Park, CA, with in-person attendance required at least 3 days per week, you will shape how agentic systems are built,

Qualifications

• Deep experience defining and measuring quality for agentic or ML systems using evaluation frameworks, datasets, and scorecards.
• Experience evaluating large language models or similar systems, including tradeoffs in performance, cost, and latency.
• Demonstrated ability to analyze production issues and lead improvements across multiple teams.
• Comfortable working with engineers, data scientists, and product partners to deliver measurable improvements in system performance.

Responsibilities

• Define and implement evaluation frameworks that measure agent performance, including task success, correctness, tool usage reliability, latency, safety, and user satisfaction
• Evaluate frontier and fine-tuned models across quality, latency, cost, and edge cases to determine appropriate use cases
• Partner with product managers, data scientists, and engineers to translate evaluation results into clear launch criteria for agentic systems
• Analyze production issues, identify root causes, and prioritize improvements to increase system reliability and performance
• Build visibility into agent performance through metrics, monitoring, and reporting that inform roadmap decisions

Skills

Quality evaluation frameworks

LLM evaluation

Production issue analysis

Cross-functional collaboration

Job description

Robinhood seeks a Staff Machine Learning Engineer (IC6) to define and uphold the quality bar for agentic systems across the organization. You will design evaluation frameworks, guide model selection, and partner with product, data science, and engineering teams to ensure systems meet standards for correctness, safety, latency, and user satisfaction.

Based in Bellevue, WA or Menlo Park, CA, with in-person attendance required at least 3 days per week, you will shape how agentic systems are built,