Senior Machine Learning Engineering Manager

Capital Rx; New York (NY); Hybrid; USD 190,000 - 237,000; Full time

Job summary

Judi Health is seeking a Senior Machine Learning Engineering Manager to lead hands-on ML projects and a growing team. You will design and deploy AI systems leveraging NLP, NLG, multimodal data, chatbots, and RAG-based QnA, while collaborating across disciplines in a fast-paced startup environment.

The role focuses on productionizing ML solutions, API design, and end-to-end model lifecycle, with a strong emphasis on security and HIPAA compliance in healthcare data.

Qualifications

• Bachelor's or Master's degree in Computer Science, ML, or related quantitative field.
• 8+ years in ML solutions development and production deployment (4 years with Master's).
• 3+ years in engineering management with teams of 4+ engineers.
• Experience across AI development lifecycle (AI DLC).
• Strong OOP, design patterns, efficient algorithms, and software development.
• Proficiency in Python and familiarity with ML libraries such as PyTorch.
• Familiarity with AWS or Azure.
• Experience with GenAI services and prompt engineering.
• Strong collaboration, communication, and customer focus.

Responsibilities

• Lead ML projects from planning to delivery with timely, budget-conscious execution.
• Manage and grow a team; productionize ML solutions for NLP, NLG, multimodal analysis, and GenAI, including RAG-based QnA.
• Oversee API design for seamless integration with AI models and services.
• Guide the full ML model lifecycle: problem definition, data exploration, feature engineering, training, validation, and deployment.
• Participate in code reviews, testing, and QA processes.
• Troubleshoot AI model deployment and backend integration issues.
• Document system designs and architectural decisions clearly.
• Ensure HIPAA-compliant handling of healthcare data and security practices.

Skills

Python

PyTorch

GenAI

NLP

NLG

LLM

Cloud platforms

APIs

Strong communication

Education

Bachelor's or Master's degree in CS/ML or related field

Tools

AWS

Azure

OpenAI GPT

Anthropic Claude

Google Gemma

Job description

About Judi Health

Judi Health is a health technology company providing benefit administration solutions to employers, unions, health plans, and government entities. Judi Health replaces fragmented, outdated systems with the industry's first Unified Claims Processing architecture, seamlessly consolidating pharmacy and medical benefit administration on a single, secure platform. By delivering true price transparency, eliminating unnecessary middleman fees, and leveraging advanced AI-powered care delivery, Judi Health helps clients achieve unprecedented operational efficiency and service levels. At Judi Health, we're deploying the infrastructure our country needs to deliver the healthcare we all deserve. We are the intelligence platform powering benefits plans for millions of Americans and proudly leading the next generation of care. To learn more, visit www.judi.health.

Location: Hybrid 3 days in office (New York, NY, Denver, CO or Charlotte, NC area)

Position Summary

Join our mission to infuse cutting-edge AI/ML/GenAI into health benefit management as a Senior Machine Learning Engineering Manager. We are looking for an experienced software engineer with hands-on machine learning and leadership expertise to join us in expanding our AI capabilities, enabling increased productivity and magical experiences in our products and services.

In this role you will be expected to lead the design and implementation of complex AI systems that leverage ML models for NLP, NLG, multimodal data analysis, chatbots, and RAG-based QnA. We want people who like leading and working in a collaborative team environment and enjoy creating practical, efficient, and high-performance software that leverages Large Language Models (LLM), Multimodal Language Models(MLM), and other ML models and techniques to build amazing capabilities for our customers, partners, and employees. Most importantly, we are a mission-oriented, high-growth startup and we are looking for folks that are excited to be part of our journey to make lasting impact towards transforming healthcare.

Responsibilities

• Lead and oversee ML projects from planning to delivery, ensuring timely and budget-friendly completion. Conduct performance reviews, provide feedback, and support professional growth of your team members.
• Manage a team and also contribute towards productionizing machine learning (ML) solutions in the fields of Document understanding, Search and QnA, GenAI, Virtual Agents, etc.
• Oversee the design and implementation of APIs for seamless integration with AI models and services.
• Work across the complete lifecycle of ML model development, including problem definition, data exploration, feature engineering, model training, validation, and deployment.
• Participate in code reviews, testing, and quality assurance processes.
• Troubleshoot and resolve technical issues related to AI model, integration, deployment and backend services.
• Document and communicate development processes, system designs, and architectural decisions.
• Ensure the security and compliance of healthcare data, adhering to HIPAA regulations.

Required Qualifications

• Bachelor's or Master's degree in Computer Science, Machine Learning, or a related quantitative field.
• Minimum 8+ years (4 years with Masters degree) of experience in industry with a strong focus on ML solutions development and production deployment.
• At least 3+ years of experience in Engineering Management with teams of 4 or more engineers.
• Experience working across the AI development lifecycle (AI DLC).
• Strong grasp of OOP, Design Patterns, efficient algorithms, and quality software development.
• Strong proficiency in Python and familiarity with ML libraries such as PyTorch.
• Familiarity with cloud platforms such as AWS or Azure.
• Familiarity with GenAI services such as OpenAI GPT, Anthropic Claude, Google Gemma etc. Experience developing and fine-tuning prompts on any of the GenAI services.
• Passion for customer, innovation, product quality, service excellence, and test engineering.
• The ability to work collaboratively across multiple disciplines in an extremely fast-paced, startup environment.
• Strong written and communication skills.

Salary Range

New York, NY Salary Range: $189,600 — $237,000 USD

Denver, CO Salary Range: $174,000 — $217,500 USD

Charlotte, NC Salary Range: $158,000 — $197,500 USD

All employees are responsible for adherence to the Judi Health Code of Conduct including the reporting of non-compliance. This position description is designed to be flexible, allowing management the opportunity to assign or reassign duties and responsibilities as needed to best meet organizational goals.

We provide equal employment opportunities to all employees and applicants for employment and prohibit discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, medical condition, genetic information, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

By submitting an application, you agree to the retention of your personal data for consideration for a future position at Judi Health. More details about Judi Health's privacy practices can be found athttps://www.judi.health/legal/privacy-policy.