MLOps Engineer - Production LLMs for Healthcare AI

kadence; New York (NY); Hybrid; USD 120,000 - 190,000; Full time

Job summary

Kadge Kadence in New York City is seeking a Machine Learning Engineer - MLOps to own production AI systems and keep them reliable as the customer base scales. The role blends infrastructure, evaluation, and monitoring with a strong ownership mindset.

You will collaborate with AI engineers and clinical experts, operate LLM workloads, and build scalable pipelines to track experiments, measure costs, and improve inference performance in a healthcare-focused environment.

Qualifications

• 4 years of experience, incl. 2–3 years in MLOps.
• Strong Python and production-grade LLM workloads.
• Experience owning evaluation for production AI agents.
• Hands-on model development, training and fine-tuning.
• Familiar with MLflow or Weights & Biases for tracking.
• Experience with AWS Bedrock / Azure OpenAI or CI/CD is a plus.

Responsibilities

• Operate production LLM workloads using Kubernetes and orchestrators.
• Build agent evaluation with gates to catch regressions.
• Develop experiment tracking, production monitoring, and versioned pipelines.
• Develop and fine-tune ML models and improve inference performance.

Skills

Python

LLM workloads

Agent evaluation

Experiment tracking

Tools

MLflow

Weights & Biases

CI/CD

AWS Bedrock

Azure OpenAI

Job description

Kadge Kadence in New York City is seeking a Machine Learning Engineer - MLOps to own production AI systems and keep them reliable as the customer base scales. The role blends infrastructure, evaluation, and monitoring with a strong ownership mindset.

You will collaborate with AI engineers and clinical experts, operate LLM workloads, and build scalable pipelines to track experiments, measure costs, and improve inference performance in a healthcare-focused environment.