Research Engineer, Knowledge & Evaluation Systems

Neura Market; San Francisco, Northern (CA, KY); Hybrid; USD 350,000 - 850,000; Full time

Job summary

Anthropic is seeking a Research Engineer on the Knowledge team to design and run experiments that improve Claude's search, retrieval, and reasoning over information at scale.

You will build training environments, curate data, and contribute to evaluation suites while collaborating with researchers across RL Data, post-training, and product teams. This hybrid role emphasizes reliable, observable systems and scalable tooling.

Qualifications

• Experienced Python engineer with a track record of shipping reliable, well-instrumented code.
• Experience designing, running, and analyzing ML experiments.
• Ability to work across the stack—from data pipelines to model training to evaluation.
• 5+ years of experience operating ML or distributed systems at scale.
• Clear written and verbal communication across time zones.
• Finds genuine satisfaction and impact in making critical systems dependable.

Responsibilities

• Design, build, and iterate on training environments and data pipelines that improve Claude's ability to reason over knowledge-intensive tasks
• Run experiments end-to-end: form a hypothesis, build the infrastructure, train models, analyze results, and decide what to try next
• Develop evaluations that meaningfully capture progress on search, retrieval, and reasoning quality
• Identify failure modes in current model behavior and translate them into concrete training signals
• Collaborate closely with researchers across RL Data, post-training, and product teams to align on priorities and ship improvements
• Contribute to shared infrastructure and tooling that compounds the team's velocity over time
• Own a clean, canonical set of evaluation tools and processes for Knowledge Work capabilities, including the process used for model releases
• Build and automate observability, dashboards, and operational tooling for our training environments and evaluation systems, with an emphasis on high signal-to-noise

Skills

Python

ML experiments

Distributed systems

Data pipelines

Model training

Cross-time-zone communication

Job description

Anthropic is seeking a Research Engineer on the Knowledge team to design and run experiments that improve Claude's search, retrieval, and reasoning over information at scale.

You will build training environments, curate data, and contribute to evaluation suites while collaborating with researchers across RL Data, post-training, and product teams. This hybrid role emphasizes reliable, observable systems and scalable tooling.