AI Engineer: Build Production-Ready Models & Agents

Momentic; San Francisco (CA); On-site; USD 180,000 - 260,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

401(k)

Unlimited PTO

US holidays

Daily lunch

Fully stocked kitchen

Job summary

Momentic is building the definitive verification layer for software: an AI-native testing platform that helps engineering teams catch bugs before they ship. You will join the engineering team in San Francisco to work closely with our CTO on improving the models and agents behind Momentic.

We’re seeking a hands-on AI engineer who can fine-tune models, build evaluations, and turn production data into more reliable, efficient agents.

Qualifications

• 3+ years of software engineering experience with hands-on AI-powered production systems.
• Hands-on experience with supervised fine-tuning, including data preparation and evaluation.
• Experience with prompt/context tuning, evaluation datasets, and LLM observability to diagnose failures and measure improvements.
• Strong engineering fundamentals and ability to write efficient, reliable code.
• Experience using AI agents to build software and manage ambiguity to deliver results.

Responsibilities

• Fine-tune models for long-running agents and diagnose whether failures arise from infrastructure, code, or authorship.
• Build and curate training/evaluation datasets from production workflows.
• Develop LLM evaluations and observability linking offline results to production behavior.
• Tune prompts, context, and model behavior to improve task success, latency, and cost.
• Own technical projects from definition to delivery with cross-team collaboration.

Skills

Software engineering

AI production systems

Fine-tuning

Prompt tuning

LLM observability

Autonomy

Problem solving

Job description

Momentic is building the definitive verification layer for software: an AI-native testing platform that helps engineering teams catch bugs before they ship. You will join the engineering team in San Francisco to work closely with our CTO on improving the models and agents behind Momentic.

We’re seeking a hands-on AI engineer who can fine-tune models, build evaluations, and turn production data into more reliable, efficient agents.