Senior ML Engineer II — GenAI & NLP Innovator (Hybrid)

Judi Health, LLC; United States; Hybrid; USD 165,000 - 206,000; Full time

Job summary

Judi Health in New York, NY is seeking a Senior Machine Learning Engineer II to advance our AI-powered pharmacy benefits platform. You will design and productionize ML systems for NLP, GenAI, and RAG-based QnA, building scalable models and APIs that empower our products and customers.

We value collaboration in a fast-paced startup culture, strong Python/PyTorch skills, and the ability to deploy end-to-end ML solutions while ensuring HIPAA compliance and robust testing.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Machine Learning, or a related quantitative field.
• Minimum 6+ years of experience in industry with a strong focus on ML solutions development and production deployment.
• Strong grasp of OOP, Design Patterns, efficient algorithms, and quality software development.
• Strong proficiency in Python and familiarity with ML libraries such as PyTorch.
• Statistical Machine Learning and Artificial Intelligence in the context of NLP, Speech, RAG, Virtual Agents, and/or Document Processing technologies
• Familiarity with cloud platforms such as AWS or Azure.
• Familiarity with GenAI services such as OpenAI GPT, Anthropic Claude, Google Gemma etc. Experience developing and fine-tuning prompts on any of the GenAI services
• Excellent problem-solving skills, attention to detail, and a strong capacity for logical thinking.
• Passion for customer, innovation, product quality, service excellence, and test engineering
• The ability to work collaboratively across multiple disciplines in an extremely fast-paced, startup environment.
• Experience working with microservices/an API-based application paradigm.
• Good written communication skills that enable collaboration in a remote environment.

Responsibilities

• Design, develop, and productionize machine learning (ML) solutions in the fields of Document understanding, Search and QnA, GenAI, Virtual Agents, etc.
• Develop and maintain backend services using Python, focusing on AI-driven applications.
• Design and implement APIs for seamless integration with AI models and services.
• Collaborate with product managers, engineers, and other stakeholders as a specialist and subject matter expert in machine learning.
• Work across the complete lifecycle of ML model development, including problem definition, data exploration, feature engineering, model training, validation, and deployment.
• Participate in code reviews, testing, and quality assurance processes.
• Troubleshoot and resolve technical issues related to AI model, integration, deployment and backend services.
• Implement system telemetry, A/B testing and other statistical methods to validate the effectiveness of AI models. Ensure the integrity and robustness of ML solutions by developing automated testing and validation processes.
• Document and communicate development processes, system designs, and architectural decisions.
• Ensure the security and compliance of healthcare data, adhering to HIPAA regulations.

Skills

Python

PyTorch

NLP

GenAI

MLOps

APIs

Cloud AWS/Azure

LLMs/Multimodal

Microservices

Team collaboration

Education

Bachelor's or Master's in CS/ML

Tools

AWS

Azure

OpenAI GPT

Anthropic Claude

Google Gemma

Job description

Judi Health in New York, NY is seeking a Senior Machine Learning Engineer II to advance our AI-powered pharmacy benefits platform. You will design and productionize ML systems for NLP, GenAI, and RAG-based QnA, building scalable models and APIs that empower our products and customers.

We value collaboration in a fast-paced startup culture, strong Python/PyTorch skills, and the ability to deploy end-to-end ML solutions while ensuring HIPAA compliance and robust testing.