Remote AI Operations Lead - LLM & Conversation Systems

Pavago; États-Unis; À distance; USD 120 000 - 180 000; Plein temps

Résumé du poste

Pavago is seeking an AI Operations Specialist to own and improve production AI conversation systems for our telehealth SMS lead recovery platform. You will onboard clients, configure AI workflows, monitor live conversations, diagnose issues, and measure impact on conversions.

This is a hands-on role requiring you to run LLM systems, test changes, and document improvements. You will collaborate directly with the founder to move quickly while maintaining high standards for customer-facing AI

Qualifications

• Proven experience running LLM or AI systems in production.
• Hands-on experience monitoring and improving production AI outputs.
• Experience with prompt engineering and system prompt optimization.
• Strong understanding of LLM behavior, failure modes, and iterative testing.
• Experience analyzing AI-generated conversations or customer-facing outputs.
• Ability to work with webhooks, APIs, knowledge bases, or similar integrations.
• Strong analytical and problem-solving skills.
• Excellent written English for editing customer-facing AI messages and documentation.
• Strong attention to detail and ownership of production systems.

Responsabilités

• Onboard new clients into the AI conversation platform and configure campaigns.
• Monitor live AI-generated conversations and diagnose issues affecting performance.
• Write, edit, and improve prompts and system instructions based on data.
• Test changes systematically before and after deployment and document results.
• Collaborate with the founder on daily AI operations and improvements.

Connaissances

LLM production experience

Production monitoring

Prompt engineering

LLM behavior knowledge

Conversion-focused analysis

APIs & webhooks

Analytical problem solving

Excellent written English

Independent ownership

Description du poste

Pavago is seeking an AI Operations Specialist to own and improve production AI conversation systems for our telehealth SMS lead recovery platform. You will onboard clients, configure AI workflows, monitor live conversations, diagnose issues, and measure impact on conversions.

This is a hands-on role requiring you to run LLM systems, test changes, and document improvements. You will collaborate directly with the founder to move quickly while maintaining high standards for customer-facing AI