Applied AI Engineer

contactmonkey

United States

Remote

USD 98,000 - 112,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

contactmonkey is seeking an AI-focused engineer to build and ship AI-powered capabilities for its business communications product. You will design agent workflows, develop evaluation pipelines, and operate AI infrastructure with reliability engineers.

Collaboration with product and reliability teams will drive production-ready features and safe prompt management. The role emphasizes shipping features, measuring impact, and managing costs in a Kubernetes-enabled environment, with a downtown

Qualifications

  • Bachelor's degree or higher.
  • Experience shipping LLM features in production across application code and infrastructure.
  • Ability to build reliable, measurable AI systems and use evaluation results to guide iteration.
  • Comfort partnering with product, engineering, and reliability teams to progress defined problems.

Responsibilities

  • Design and implement agent workflows, including routing, tool use, and feedback loops.
  • Build evaluation datasets, automated grading, and regression checks; use offline and live measures to assess model and prompt changes.
  • Turn production failures into new evaluations that help catch similar issues earlier.
  • Develop and operate AI infrastructure with platform and reliability engineers, including deployment paths for workloads on Kubernetes.
  • Track model costs, latency, and failures; design graceful behavior for timeouts, rate limits, and unreliable outputs, and respond to production issues.
  • Manage prompts and model settings as versioned changes that can be reviewed, released, and rolled back safely.
  • Help protect regional data boundaries and reduce risks such as unintended data exposure and prompt injection.

Skills

LLM features
Production deployment
Cross-functional collaboration
AI system reliability

Education

Bachelor's degree

Tools

Ruby on Rails
Vue.js
Amazon Bedrock
AWS
EKS
Terraform
Terragrunt
Sidekiq
MySQL
PostgreSQL
Argo CD
Karpenter

Job description

Role overview

Build and ship AI-powered capabilities for a business communications product, with responsibility spanning agent workflows, evaluation, and the infrastructure that supports them. The work is hands-on and iterative: you'll partner with senior engineers and product colleagues to move ideas into production, measure whether they work, and keep them dependable in real use.

Responsibilities
  • Design and implement agent workflows, including routing, tool use, and feedback loops.
  • Build evaluation datasets, automated grading, and regression checks; use offline and live measures to assess model and prompt changes.
  • Turn production failures into new evaluations that help catch similar issues earlier.
  • Develop and operate AI infrastructure with platform and reliability engineers, including deployment paths for workloads on Kubernetes.
  • Track model costs, latency, and failures; design graceful behavior for timeouts, rate limits, and unreliable outputs, and respond to production issues.
  • Manage prompts and model settings as versioned changes that can be reviewed, released, and rolled back safely.
  • Help protect regional data boundaries and reduce risks such as unintended data exposure and prompt injection.
Requirements
  • Bachelor's degree or higher; the available source truncates the degree field of study, so it is not specified here.
  • Experience shipping LLM features in production and working across application code and infrastructure.
  • Ability to build reliable, measurable AI systems and use evaluation results to guide iteration.
  • Comfort partnering with product, engineering, and reliability teams, making progress on defined problems, and communicating blockers and learnings.
Nice to have

Experience with the listed production environment: Ruby on Rails, Vue.js, Amazon Bedrock, AWS and EKS, Terraform or Terragrunt, Sidekiq, MySQL or PostgreSQL, Argo CD, and Karpenter.

Benefits and work setup

This is a new position based in downtown Toronto, with the team working in the office three days per week or as needed.

The listed salary range is $140,000-$160,000.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff AI Developer - Canada
Staff AI Developer - Canada

robotsandpencils • United States

Remote
USD 124,000 - 159,000
Paid time off
Medical insurance
Dental insurance
+2
Applied AI Engineer
Applied AI Engineer

Mizo • United States

Remote
USD 77,000 - 119,000
Product Engineer (AI / Full-Stack)
Product Engineer (AI / Full-Stack)

greatquestion • United States

Remote
USD 77,000 - 105,000
Generous salary set by internal rubric
Remote anywhere in Canada
4 weeks paid time off
+2
Enterprise AI Engineer
Enterprise AI Engineer

Quix • United States

Remote
USD 110,000 - 180,000
Staff AI Developer
Staff AI Developer

robotsandpencils • United States

Remote
USD 124,000 - 171,000
AI Engineer
AI Engineer

Pokee AI • United States

Remote
USD 120,000 - 180,000
Senior Software Engineer - AI Experiences
Senior Software Engineer - AI Experiences

Mercury • United States

Remote
USD 201,000 - 251,000
Equity
Benefits package
Staff AI Engineer - USA
Staff AI Engineer - USA

podium81 • United States

Remote
USD 180,000 - 240,000
Medical/dental/vision
Life and disability insurance
Parental leave
+3
AI Engineer (Customer Facing)
AI Engineer (Customer Facing)

RapidCanvas • United States

Remote
USD 120,000 - 180,000
AI Engineer
AI Engineer

Iwana Labs • United States

Remote
USD 99,000 - 166,000
22 days PTO
Meal allowance
Private health insurance
+3