Research Engineer, Model Evaluation and Improvement

Benchling, Inc.

San Francisco (CA)

On-site

USD 140,000 - 220,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Benchling, Inc. is building an AI scientist for science customers. You’ll work at the intersection of software engineering, biology, and frontier AI, turning complex data into rigorous tasks for models and evaluations.

You’ll collaborate with scientists and external labs to close gaps in real-world reasoning and drive impact across discovery and development. The role emphasizes building datasets, evaluating model failures, and creating scalable data infrastructure, with an emphasis on rapid

Qualifications

  • 2+ years at the intersection of biology and AI, with academic or industry experience evaluating and improving scientific models or LLMs for biological applications.
  • Experience building with LLMs, with intuition for where current models excel and where they struggle.
  • Curiosity and excitement about frontier AI, with a desire to understand and push capabilities.
  • Comfort working on ambiguous problems in a rapidly shifting landscape.
  • Collaborative mindset, able to work with engineers, scientists, and external partners.
  • Desire to work in a fast-paced environment with rapid experimentation.

Responsibilities

  • Build datasets for evaluating and improving frontier models, turning complex scientific data into high-quality tasks and environments for LLMs.
  • Analyze model failure modes, running experiments across frontier models to understand where they struggle.
  • Build scalable data infrastructure, creating pipelines that curate, transform, and validate large volumes of scientific data into tasks for evaluation.
  • Collaborate with frontier AI labs to develop and evaluate approaches for improving models on challenging scientific tasks.
  • Work closely with scientists, translating expert judgment into problems and evaluation criteria that differentiate strong model behavior.

Skills

Biology & AI
LLMs
Collaboration
Ambiguity
Fast-paced

Job description

We are rebuilding biotech for the AI era.
When a breakthrough is delayed, the world waits. Getting a molecule from discovery to patients, or a crop from lab to field, involves thousands of slow, manual, disconnected steps. AI has the potential to change this, compressing decades of R&D work into years. But that only happens when clean, structured scientific data and AI are built into how science gets done.

ROLE OVERVIEW

We’re building an AI scientist for our customers. We can’t do that if we haven’t built the muscle ourselves. AI fluency is the foundation we build on; it's core to how we work, and we're committed to helping every new hire integrate it into their day‑to‑day. As part of our interview process, you'll complete a brief AI-focused exercise or discussion so we can understand how you think about and use AI to drive impact in your role. Feel free to reference any tools, platforms, or workflows you use today.

We’re a team focused on making frontier AI models better at science. LLMs know an extraordinary amount of biology, but there’s still a large gap in reasoning for the real-world problems scientists face every day. We recently published some of our work here.

You’ll build the datasets, evaluations, and systems that help close that gap. You’ll work with scientists to turn complex scientific work into rigorous tasks that models can learn from and be evaluated against. You’ll partner with leading AI labs to understand where models fail and how to improve them.

This is an early and rapidly evolving area. You’ll work at the intersection of software engineering, biology, and frontier AI: finding tasks that are challenging for LLMs and valuable to scientists, designing evaluations that capture real scientific judgment, and building systems to create these tasks at scale.

RESPONSIBILITIES
  • Build datasets for evaluating and improving frontier models, turning complex scientific data into high-quality tasks and environments for LLMs.
  • Analyze model failure modes, running experiments across frontier models to understand where they struggle and identify opportunities for improvement.
  • Build scalable data infrastructure, creating pipelines that curate, transform, and validate large volumes of scientific data into tasks for model evaluation and improvement.
  • Collaborate with frontier AI labs, helping develop and evaluate new approaches for improving models on challenging scientific tasks.
  • Work closely with scientists, translating expert judgment into problems and evaluation criteria that can reliably distinguish strong model behavior.
QUALIFICATIONS
  • 2+ years at the intersection of biology and AI, with academic or industry experience evaluating and improving scientific models or LLMs for biological applications.
  • Experience building with LLMs, with an intuition for where current models excel, where they struggle, and how to design systems around their capabilities.
  • Curiosity and excitement about frontier AI, with a desire to understand and push the capabilities of rapidly improving models.
  • Comfort working on ambiguous problems, where the playing field is rapidly shifting and the right technical approaches are still being discovered.
  • Collaborative mindset, able to work closely with engineers, scientists, and external research partners.
  • Desire to work in a fast-paced environment, where priorities can shift and rapid experimentation is encouraged.
HOW WE WORK

We prioritize in-office collaboration. Employees are expected to be on-site 5 days per week (Monday - Friday).

#LI-KW

Benchling welcomes everyone.

We believe diversity enriches our team so we hire people with a wide range of identities, backgrounds, and experiences.

We are an equal opportunity employer. That means we don’t discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status. We also consider for employment qualified applicants with arrest and conviction records, consistent with applicable federal, state and local law, including but not limited to the San Francisco Fair Chance Ordinance.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Research Engineer, Model Evaluation and Improvement
Research Engineer, Model Evaluation and Improvement

Benchling • San Francisco (CA)

On-site
USD 136,000 - 167,000
Research Engineer, Model Evaluation and Improvement
Research Engineer, Model Evaluation and Improvement

Benchling, Inc. • San Francisco (CA)

On-site
USD 150,000 - 230,000
Software Engineer, Agents
Software Engineer, Agents

Benchling, Inc. • San Francisco (CA)

On-site
USD 140,000 - 190,000
Product Manager, Scientific AI Models
Product Manager, Scientific AI Models

Benchling • San Francisco (CA)

On-site
USD 140,000 - 230,000
Software Engineer, Full Stack (Enterprise Lifecycle) (High Seniority)
Software Engineer, Full Stack (Enterprise Lifecycle) (High Seniority)

Benchling, Inc. • San Francisco (CA)

Hybrid
USD 180,000 - 280,000
Software Engineer, Tools and Automation
Software Engineer, Tools and Automation

Benchling, Inc. • San Francisco (CA)

Hybrid
USD 170,000 - 260,000
Software Engineer, Platform (Developer Experience)
Software Engineer, Platform (Developer Experience)

Benchling • United States

Hybrid
USD 120,000 - 180,000
Software Engineer, Tools and Automation
Software Engineer, Tools and Automation

Benchling • San Francisco (CA)

Hybrid
USD 195,000 - 265,000
Technical Solution Architect
Technical Solution Architect

Benchling, Inc. • San Francisco (CA)

Hybrid
USD 140,000 - 210,000
Hybrid work arrangement
On-site collaboration 3 days/week
Technical Solution Architect
Technical Solution Architect

Benchling • San Francisco (CA)

Hybrid
USD 180,000 - 280,000