AI Agent Operations Engineer: Reliability & Optimization

Momcozy; Los Angeles (CA); In loco; USD 110.000 - 170.000; Tempo pieno

Descrizione del lavoro

Momcozy's Los Angeles AI engineering team is seeking an Agent Operations Engineer to keep agent products reliable in production. You will configure model services, prompts, tools, and knowledge bases to optimize workflows.

You will monitor quality metrics, latency, token costs, and user satisfaction, triage incidents, and drive safe, scalable deployment with runbooks and A/B tests. This role requires strong English and US work authorization.

Competenze

• 3+ years in software development, operations, support, or AI/LLM operations.
• Experience with prompt management, model APIs, observability, incident response, and automation.
• Bachelor’s degree or equivalent; legally authorized to work in the United States.

Mansioni

• Configure model services, prompts, tools, knowledge bases, and agent workflows.
• Monitor response quality, latency, TTFT, token cost, user satisfaction, and operational health.
• Triage incidents, run evaluations, manage staged rollouts and A/B tests, and maintain runbooks.
• Build feedback loops and improve safety, privacy, access control, and AI-assisted coding workflows.

Conoscenze

Software development experience

Operations experience

AI/LLM operations

Technical support

Formazione

Bachelor’s degree or equivalent industry experience

Descrizione del lavoro

Momcozy's Los Angeles AI engineering team is seeking an Agent Operations Engineer to keep agent products reliable in production. You will configure model services, prompts, tools, and knowledge bases to optimize workflows.

You will monitor quality metrics, latency, token costs, and user satisfaction, triage incidents, and drive safe, scalable deployment with runbooks and A/B tests. This role requires strong English and US work authorization.