Applied AI Engineer: Production LLM & Infra

contactmonkey; United States; Remote; USD 98,000 - 112,000; Full time

Job summary

contactmonkey is seeking an AI-focused engineer to build and ship AI-powered capabilities for its business communications product. You will design agent workflows, develop evaluation pipelines, and operate AI infrastructure with reliability engineers.

Collaboration with product and reliability teams will drive production-ready features and safe prompt management. The role emphasizes shipping features, measuring impact, and managing costs in a Kubernetes-enabled environment, with a downtown

Qualifications

• Bachelor's degree or higher.
• Experience shipping LLM features in production across application code and infrastructure.
• Ability to build reliable, measurable AI systems and use evaluation results to guide iteration.
• Comfort partnering with product, engineering, and reliability teams to progress defined problems.

Responsibilities

• Design and implement agent workflows, including routing, tool use, and feedback loops.
• Build evaluation datasets, automated grading, and regression checks; use offline and live measures to assess model and prompt changes.
• Turn production failures into new evaluations that help catch similar issues earlier.
• Develop and operate AI infrastructure with platform and reliability engineers, including deployment paths for workloads on Kubernetes.
• Track model costs, latency, and failures; design graceful behavior for timeouts, rate limits, and unreliable outputs, and respond to production issues.
• Manage prompts and model settings as versioned changes that can be reviewed, released, and rolled back safely.
• Help protect regional data boundaries and reduce risks such as unintended data exposure and prompt injection.

Skills

LLM features

Production deployment

Cross-functional collaboration

AI system reliability

Education

Bachelor's degree

Tools

Ruby on Rails

Vue.js

Amazon Bedrock

AWS

EKS

Terraform

Terragrunt

Sidekiq

MySQL

PostgreSQL

Argo CD

Karpenter

Job description

contactmonkey is seeking an AI-focused engineer to build and ship AI-powered capabilities for its business communications product. You will design agent workflows, develop evaluation pipelines, and operate AI infrastructure with reliability engineers.

Collaboration with product and reliability teams will drive production-ready features and safe prompt management. The role emphasizes shipping features, measuring impact, and managing costs in a Kubernetes-enabled environment, with a downtown