Applied AI Engineer - Build Self-Improving Agent Systems

judgmentlabs

San Francisco (CA)

On-site

USD 180,000 - 260,000

Full time

14 days+
Application generator

Get a reply from this employer — a resume and cover letter tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

judgmentlabs is seeking Applied AI Engineers to build AI systems that use agent interaction data to understand, evaluate, and improve agent behavior at scale. You'll work with real-world data, apply frontier production methods, and ship your work into the product.

You will own projects end-to-end with autonomy and collaborate with teams across finance, legal, and operations on high-stakes workflows. Collaborate with external companies and research partners on frontier AI research to push the

Qualifications

  • Agency: intellectually curious, self-directed, up-to-date with research trends.
  • Depth of thought: reason clearly about abstract systems; RL experience preferred.
  • Ownership: own outcomes and drive impact beyond tasks.

Responsibilities

  • Build AI systems to aggregate, index, and analyze large-scale long-running agent interaction data.
  • Design post-training and optimization workflows to improve agents.
  • Build agent platform infrastructure, including orchestration, runtimes, and developer tools.
  • Build internal tools and infrastructure to support rapid experimentation, analysis, and training.
  • Work closely with product to integrate agents into customer-facing workflows.
  • Collaborate with external companies and research partners on frontier AI research.

Skills

Agency
Depth of thought
Ownership

Job description

judgmentlabs is seeking Applied AI Engineers to build AI systems that use agent interaction data to understand, evaluate, and improve agent behavior at scale. You'll work with real-world data, apply frontier production methods, and ship your work into the product.

You will own projects end-to-end with autonomy and collaborate with teams across finance, legal, and operations on high-stakes workflows. Collaborate with external companies and research partners on frontier AI research to push the

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Production AI Engineer: Scalable Agent Systems
Production AI Engineer: Scalable Agent Systems

Judgment Labs • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 280,000
Product Engineer: AI Agent Platform & Debugger
Product Engineer: AI Agent Platform & Debugger

judgmentlabs • San Francisco (CA)

On-site
USD 140,000 - 190,000
Applied AI Engineer
Applied AI Engineer

Judgment Labs • San Francisco (CA), Northern (KY)

Hybrid
USD 180,000 - 280,000
Full-Stack Engineer - AI Agent Platform & Debug UX
Full-Stack Engineer - AI Agent Platform & Debug UX

Judgment Labs • San Francisco (CA)

On-site
USD 150,000 - 210,000
Product Engineer - AI Judgment Platform
Product Engineer - AI Judgment Platform

Judgment Labs • San Francisco (CA)

On-site
USD 150,000 - 210,000
Applied AI Engineer
Applied AI Engineer

judgmentlabs • San Francisco (CA)

On-site
USD 180,000 - 260,000
Senior AI Engineer: Agentic LLM Systems in Production
Senior AI Engineer: Agentic LLM Systems in Production

Vibehackers • Chicago (IL), Northern (KY)

Hybrid
USD 180,000 - 220,000
Equity options
Health, dental, and vision
Parental leave
+4
Applied AI Engineer
Applied AI Engineer

Day One Partners • New York (NY)

On-site
USD 120,000 - 210,000
AI Enablement & Automation Intern: Build GenAI Agents
AI Enablement & Automation Intern: Build GenAI Agents

Triwill Group • New York (NY), Northern (KY)

Hybrid
USD 30,000 - 55,000
Product engineer, full stack
Product engineer, full stack

Judgment Labs • San Francisco (CA)

On-site
USD 150,000 - 210,000