AI Engineer

present of AI; San Francisco (CA); On-site; USD 120,000 - 190,000; Full time

Job summary

Momentic is seeking a hands-on AI QA engineer to improve the models and agents behind our AI testing product. You will fine-tune models, build training and evaluation datasets from real usage, and tune prompts and context for reliability, speed, and cost.

A strong candidate has about three years of software experience and has shipped AI features in production. This role focuses on AI work across web, iOS, and Android apps, leveraging AI agents to write, run, and repair tests.

Qualifications

• Fine-tuning AI models and building training/evaluation datasets.
• Tuning prompts and context for reliability, speed and cost.
• Shipped production AI features and hands-on software experience.

Responsibilities

• Improve models and agents behind an AI testing product.
• Build training and evaluation datasets from real usage.
• Tune prompts and context to improve reliability, speed and cost.

Skills

Fine-tuning

Dataset creation

Prompt tuning

Job description

This role is for a hands‑on engineer who improves the models and agents behind an AI testing product. The work covers fine‑tuning, building training and evaluation datasets from real usage, and tuning prompts and context for reliability, speed and cost. A strong candidate has about three years of software experience, has shipped AI features in production, and can take a vague problem to a finished result with little direction.

How it fits the AI era

The whole job is AI work, since the product is agents that write, run and repair tests. Models handle the repetitive checking, while people decide what a good result looks like, design fair experiments and judge when an agent is actually better. Using AI agents to build software is also part of the day to day, so knowing when to step in and redirect them matters.

How it builds AI experience

Worth showing

• Supervised fine‑tuning projects
• Production AI features shipped
• Prompt and context tuning

This is our own read, written from the employer's posting and the company's Spotlight. The employer's posting is the source of truth for the role.

About Momentic

An AI QA engineer that writes, runs and repairs software tests from plain‑English instructions, for web, iOS and Android apps.