Machine Learning Engineer

ModMed

Boca Raton (FL)

On-site

USD 130,000 - 180,000

Full time

14 days+

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Medical, dental, vision

401(k) matching 50% up to 6%

Paid time off

Life and disability benefits

LinkedIn Learning access

Dog-friendly HQ

Job summary

ModMed, a healthcare software company, seeks a Machine Learning Engineer to build autonomous AI agents for triaging patient messages and managing clinical workflows on our AI-enabled platform.

You will design systems that act with high safety and accuracy, deploying multi-agent solutions and evaluating model performance to continuously improve outcomes.

Qualifications

3+ years experience in ML with AI agents and conversational NLP.
Experience building autonomous systems with LangGraph, AutoGen and CrewAI.
Hands-on with fine-tuning models and evaluation frameworks.
Knowledge of guardrails and safety mechanisms for compliant outputs.
Experience with AWS and Databricks; CI/CD for ML deployments.
Proficient in Python; familiarity with RAGAS or DeepEval.

Responsibilities

Develop autonomous AI agents to triage messages and manage clinical workflows.
Design and deploy multi-agent systems for complex, non-linear tasks.
Build conversational interfaces with context-aware, empathetic responses.
Implement evaluation pipelines for model performance and safety.

Skills

Machine Learning

AI agents

Conversational NLP

Python

Evaluation frameworks

Tools

LangGraph

AutoGen

CrewAI

No-code/Low-code

AWS

Databricks

RAGAS

DeepEval

Job description

Join the Team Modernizing Medicine

At ModMed, we’re not just building software—we’re reimagining the healthcare experience. Founded in 2010 by a practicing physician and a successful tech entrepreneur, we took a radically different approach: we hired doctors and taught them how to code. This for doctors, by doctors philosophy has allowed us to create an AI-enabled, specialty-specific cloud platform that places patients at the center of care.

A Culture of Excellence

When You Join ModMed, You’re Joining An Award-winning Team Recognized For Innovation And Employee Satisfaction. From Our Global Headquarters In Boca Raton Florida, And Extensive Employee Base In Hyderabad India, We Are a Team Of 4,500+ Passionate Problem-solvers On a Mission To Increase Medical Practice Success And Improve Patient Outcomes

Consistently ranked as a Top Place to Work

2025 Globee Business Awards: Gold Globee for “Technology Team of the Year”

2025 Black Book Awards: Ranked #1 EHR in 11 Specialties

Florida Venture Forum: Venture-Backed Company of the Year

We are growing fast, thinking big, and we are just getting started.

Ready to modernize medicine with us?

Job Description Summary

We are seeking a Machine Learning Engineer to build the active brain of our patient engagement platform. In this role, you will develop autonomous and conversational AI agents capable of triaging patient messages and managing clinical workflows.

Your mission is to design systems that don’t just respond, but act—executing complex tasks with minimal human intervention while maintaining high standards of safety, empathy, and accuracy.

What You’ll Do

Autonomous Agent Development Design and deploy multi-agent systems using frameworks such as LangGraph, AutoGen, CrewAI, or no-code/low-code agent frameworks to execute complex, non-linear clinical workflows.

Patient Engagement Agents Build and optimize conversational AI interfaces that handle message triage, sentiment analysis, and context-aware responses that are natural, empathetic, and patient-centric. Develop tool‑calling architectures that enable AI agents to interact with external APIs, EHR systems, and databases to perform real‑world actions.

Model & Agent Evaluation Design and implement evaluation frameworks to measure model and agent performance, including accuracy, reliability, safety, and task completion. Continuously improve systems using structured evaluation methodologies and feedback loops.

Safety & Guardrails Implement robust evaluation pipelines and guardrails (e.g., NeMo Guardrails) to ensure agent safety, clinical accuracy, and HIPAA compliance.

AI Observability Create and maintain dashboards to monitor agent reasoning traces, system performance, uptime, and task completion rates in production environments.

What You’ll Bring

3+ years of experience in Machine Learning with a strong focus on AI agents and conversational NLP systems.

Proven experience building autonomous systems using LangGraph, AutoGen, CrewAI, or similar no-code/low-code agent frameworks.

Hands‑on experience with fine‑tuning models and implementing rigorous evaluation frameworks to ensure agent performance, safety, and reliability. Familiarity with techniques for detecting hallucinations, bias, and failure modes in agent behavior.

Strong understanding of guardrails, alignment techniques, and safety mechanisms to ensure compliant, accurate, and trustworthy agent outputs in sensitive environments.

Hands‑on experience with AWS and Databricks, including building CI/CD pipelines for deploying machine learning models and AI agents.

Strong proficiency in Python and experience with modern evaluation frameworks such as RAGAS or DeepEval.

ModMed Benefits Highlight:

At ModMed, we believe it’s important to offer a competitive benefits package designed to meet the diverse needs of our growing workforce. Eligible Modernizers can enroll in a wide range of benefits:

United States

Comprehensive medical, dental, and vision benefits, including a company Health Savings Account contribution,

401(k): ModMed provides a matching contribution each payday of 50% of your contribution deferred on up to 6% of your compensation. After one year of employment with ModMed, 100% of any matching contribution you receive is yours to keep.