Agent Operations Engineer

Momcozy; Los Angeles (CA); Vor Ort; USD 110.000 - 170.000; Vollzeit

Zusammenfassung

Momcozy's Los Angeles AI engineering team is seeking an Agent Operations Engineer to keep agent products reliable in production. You will configure model services, prompts, tools, and knowledge bases to optimize workflows.

You will monitor quality metrics, latency, token costs, and user satisfaction, triage incidents, and drive safe, scalable deployment with runbooks and A/B tests. This role requires strong English and US work authorization.

Qualifikationen

• 3+ years in software development, operations, support, or AI/LLM operations.
• Experience with prompt management, model APIs, observability, incident response, and automation.
• Bachelor’s degree or equivalent; legally authorized to work in the United States.

Aufgaben

• Configure model services, prompts, tools, knowledge bases, and agent workflows.
• Monitor response quality, latency, TTFT, token cost, user satisfaction, and operational health.
• Triage incidents, run evaluations, manage staged rollouts and A/B tests, and maintain runbooks.
• Build feedback loops and improve safety, privacy, access control, and AI-assisted coding workflows.

Kenntnisse

Software development experience

Operations experience

AI/LLM operations

Technical support

Ausbildung

Bachelor’s degree or equivalent industry experience

Jobbeschreibung

Join our Los Angeles AI engineering team as an Agent Operations Engineer, keeping agent products reliable and effective in production.

Responsibilities

• Configure model services, prompts, tools, knowledge bases, and agent workflows.
• Monitor response quality, latency, TTFT, token cost, user satisfaction, and operational health.
• Triage incidents, run evaluations, manage staged rollouts and A/B tests, and maintain runbooks.
• Build feedback loops and improve safety, privacy, access control, and AI-assisted coding workflows.

Requirements

• 3+ years in software development, technical operations, technical support, or AI/LLM operations.
• Experience with prompt management, model APIs, observability, incident response, and automation.
• Bachelor’s degree or equivalent industry experience; legally authorized to work in the United States.

Language

Professional English; Mandarin Chinese is a plus for collaboration with China HQ.