Senior Machine Learning Engineer II

Judi Health

Charlotte (NC)

Hybrid

USD 150,000 - 200,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Judi Health, a health technology company, seeks a Senior Machine Learning Engineer II to advance AI-driven pharmacy benefits. You will design, implement, and productionize ML systems for NLP, QnA, multimodal data, and agentic AI while collaborating with product managers and engineers to deliver scalable solutions for healthcare clients.

You will work across model lifecycle, from problem framing to deployment, leveraging LLMs, MLMs, and GenAI services, in a fast-growing startup focused on

Qualifications

  • Bachelor's or Master's degree in Computer Science, Machine Learning, or a related quantitative field
  • 6+ years of industry experience focusing on ML solutions development and production deployment
  • Strong grasp of OOP, design patterns, efficient algorithms, and quality software development
  • Strong proficiency in Python and familiarity with ML libraries such as PyTorch
  • Experience with GenAI services and prompts (OpenAI, Claude, Gemini)
  • Experience designing evaluation frameworks for non-deterministic/agentic AI systems

Responsibilities

  • Design, develop, and productionize ML solutions: Document understanding, Search and QnA, GenAI, Virtual Agents
  • Develop and maintain backend services using Python for AI-driven applications
  • Design APIs for seamless integration with AI models and services
  • Evaluate multi-agent orchestration patterns and scalability for teams
  • Contribute to retrieval/search infrastructure underlying RAG systems
  • Build and maintain CI/CD pipelines for agentic AI systems
  • Collaborate with PMs, engineers, and stakeholders as ML subject matter expert
  • Lifecycle ownership: problem definition, data exploration, feature engineering, model training, validation, deployment
  • Participate in code reviews, testing, and QA processes
  • Improve telemetry, A/B testing, and automated validation for AI models
  • Document development processes, designs, and architectural decisions
  • Ensure HIPAA-compliant security and data privacy practices

Skills

ML development
Production deployment
OOP & design patterns
Python programming
NLP/GenAI concepts
Problem solving

Education

Bachelor's or Master's in CS/ML or related

Tools

PyTorch
AWS/Azure
Docker/Kubernetes
GenAI services (OpenAI, Claude, Gemini)
API design

Job description

About Judi Health

Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with the industry's first Unified Claims Processing™ architecture, seamlessly consolidating pharmacy and medical benefit administration on a single, secure platform. By delivering true price transparency, eliminating unnecessary middleman fees, and leveraging advanced AI-powered care delivery, Judi Health helps clients achieve unprecedented operational efficiency and service levels.

Location

Hybrid 3 days (offices in NYC, Denver, CO and Charlotte, NC area)

Position Summary

Join our mission to infuse cutting-edge AI/ML/GenAI into pharmacy benefits as a Senior Machine Learning Engineer II. We are looking for an experienced software engineer with machine learning expertise to join us in expanding our AI capabilities, enabling increased productivity and magical experiences in our products and services.In this role you will be expected to design and implement complex AI systems that leverage ML models for NLP, NLG, multimodal data analysis, chatbots, and RAG-based QnA. The ideal candidate should be passionate about applying AI/ML concepts to difficult problems and develop scalable solutions. We want people who like working in a collaborative team environment and enjoy creating practical, efficient, and high-performance software that leverages Large Language Models (LLM), Multimodal Language Models(MLM), and other ML models and techniques to build amazing capabilities for our customers, partners, and employees. Most importantly, we are a mission-oriented, high-growth startup and we are looking for folks that are excited to be part of our journey to make lasting impact towards transforming healthcare.

Responsibilities
  • Design, develop, and productionize machine learning (ML) solutions in the fields of Document understanding, Search and QnA, GenAI, Virtual Agents, etc.
  • Develop and maintain backend services using Python, focusing on AI-driven applications.
  • Design and implement APIs for seamless integration with AI models and services.
  • Design multi-agent orchestration patterns (e.g. supervisor/subagent architectures, tool-use boundaries, human-in-the-loop gating) and evaluate architectural tradeoffs for scaling agent development across teams.
  • Contribute to the development and scaling of the retrieval/search infrastructure underlying RAG systems (e.g. vector search clusters, embedding pipelines, capacity planning)
  • Build and maintain CI/CD pipelines supporting the build, test, and deployment of agentic AI systems.
  • Collaborate with product managers, engineers, and other stakeholders as a specialist and subject matter expert in machine learning.
  • Work across the complete lifecycle of ML model development, including problem definition, data exploration, feature engineering, model training, validation, and deployment.
  • Participate in code reviews, testing, and quality assurance processes.
  • Troubleshoot and resolve technical issues related to AI model, integration, deployment and backend services.
  • Implement system telemetry, A/B testing and other statistical methods to validate the effectiveness of AI models. Ensure the integrity and robustness of ML solutions by developing automated testing and validation processes.
  • Document and communicate development processes, system designs, and architectural decisions.
  • Ensure the security and compliance of healthcare data, adhering to HIPAA regulations.
Required Qualifications
  • Bachelor's or Master's degree in Computer Science, Machine Learning, or a related quantitative field.
  • Minimum 6+ years of experience in industry with a strong focus on ML solutions development and production deployment.
  • Strong grasp of OOP, Design Patterns, efficient algorithms, and quality software development.
  • Strong proficiency in Python and familiarity with ML libraries such as PyTorch.
  • Statistical Machine Learning and Artificial Intelligence in the context of NLP, Speech, RAG, Virtual Agents, and/or Document Processing technologies
  • Familiarity with cloud platforms such as AWS or Azure, including hands-on experience with containerized deployments
  • Familiarity with GenAI services such as OpenAI GPT, Anthropic Claude, Google Gemma etc. Experience developing and fine-tuning prompts on any of the GenAI services
  • Experience designing evaluation frameworks for non-deterministic/agentic AI systems
  • Excellent problem-solving skills, attention to detail, and a strong capacity for logical thinking.
  • Passion for customer, innovation, product quality, service excellence, and test engineering
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Machine Learning Engineer I
Senior Machine Learning Engineer I

Capital Rx Inc. • Denver (CO)

Hybrid
USD 148,000 - 202,000
Senior Machine Learning Engineering Manager
Senior Machine Learning Engineering Manager

Judi Health • Denver (CO), New York (NY), Charlotte (NC)

Hybrid
USD 174,000 - 218,000
Senior Machine Learning Engineer II
Senior Machine Learning Engineer II

Capital Rx Inc. • Denver (CO)

Hybrid
USD 166,000 - 207,000
Senior Machine Learning Engineer II
Senior Machine Learning Engineer II

Capital Rx Inc. • New York (NY)

Hybrid
USD 150,000 - 226,000
Senior Machine Learning Engineer I
Senior Machine Learning Engineer I

Judi Health, LLC • United States

Hybrid
USD 140,000 - 190,000
Senior Machine Learning Engineering Manager
Senior Machine Learning Engineering Manager

Judi Health, LLC • United States

Hybrid
USD 158,000 - 237,000
Senior Machine Learning Engineer II
Senior Machine Learning Engineer II

Judi Health, LLC • United States

Hybrid
USD 165,000 - 206,000
Senior Machine Learning Engineer I
Senior Machine Learning Engineer I

Capital Rx Inc. • Charlotte (NC)

Hybrid
USD 135,000 - 169,000
Senior Machine Learning Engineer I
Senior Machine Learning Engineer I

Capital Rx Inc. • New York (NY)

Hybrid
USD 162,000 - 202,000
Senior Machine Learning Engineer II Charlotte, North Carolina, United States; Denver, Colorado, United States; New York, New York, United States
Senior Machine Learning Engineer II Charlotte, North Carolina, United States; Denver, Colorado, United States; New York, New York, United States

Judi Health, LLC • New York (NY)

Hybrid
USD 180,000 - 226,000