Production AI Ops Specialist – LLM & Conversations

Aimlroles; United States; Remote; USD 120.000 - 160.000; Vollzeit

Zusammenfassung

Aimlroles is seeking an AI Operations Specialist to own and improve our production AI conversation systems. The role involves onboarding clients, configuring workflows, monitoring live conversations, diagnosing issues, and optimizing prompts to boost conversion.

You will work directly with the founder to drive improvements, ensure reliability, and maintain high standards for customer-facing AI output in a remote, US business hours setting.

Qualifikationen

• Proven experience running LLM or AI systems in production.
• Hands-on experience monitoring and improving production AI outputs.
• Experience with prompt engineering and system prompt optimization.
• Strong understanding of LLM behavior, failure modes, and iterative testing.
• Excellent written English; documenting system changes clearly.
• Ability to work independently and own production systems.

Aufgaben

• Onboard new clients into the AI conversation platform and configure campaigns and workflows.
• Monitor live AI conversations and diagnose issues or failures.
• Write, edit, and optimize prompts and system instructions based on performance data.
• Analyze conversations and performance data to drive improvements and conversions.
• Collaborate with the founder on daily AI operations and improvements.

Kenntnisse

LLM in production

Prompt engineering

System prompt optimization

API & webhooks

Knowledge bases

Attention to detail

Written English

Independent ownership

Tools

APIs

Knowledge bases

Webhooks

Jobbeschreibung

Aimlroles is seeking an AI Operations Specialist to own and improve our production AI conversation systems. The role involves onboarding clients, configuring workflows, monitoring live conversations, diagnosing issues, and optimizing prompts to boost conversion.

You will work directly with the founder to drive improvements, ensure reliability, and maintain high standards for customer-facing AI output in a remote, US business hours setting.