Principal Machine Learning Operations Engineer

definitivehc; Framingham (MA); On-site; USD 158,000 - 294,000; Full time

Benefits offered by this job

Medical coverage

Dental coverage

Vision coverage

Unlimited PTO

401(k) with employer contribution

Job summary

Definitive Healthcare is seeking a hands-on Principal MLOps Engineer & Functional Lead to architect and scale enterprise ML and Generative AI systems. You will design a unified, secure AI ecosystem and drive best practices across the team.

You will mentor engineers, shape pipelines, and implement automated, scalable solutions for training, deployment, and monitoring at large scale.

Qualifications

• Bachelor's or Master's degree required in a quantitative field.
• 12+ years in data engineering/ML engineering, with 5+ years in MLOps in production.
• Hands-on production experience with Databricks and native AWS.
• Proficient in Python with production deployments using TensorFlow/PyTorch.

Responsibilities

• Design, implement, and maintain scalable ML and data pipelines for CI/CD and model deployments.
• Architect enterprise feature and vector stores for low-latency retrieval in traditional ML and RAG apps.
• Build and manage workflow orchestration for multi-stage training and data processing dependencies.
• Lead Generative AI infrastructure, enabling LLm apps, RAG pipelines, and multi-agent AI workflows.
• Enable efficient environments for training and fine-tuning open-source and proprietary models.
• Optimize low-latency inference pipelines with caching and distribution for high concurrency.
• Establish lifecycle policies using an enterprise model registry for versioning and lineage.

Skills

ML engineering

Data engineering

MLOps

Cloud computing

Education

Bachelor's or Master's degree in CS/CE/Data Science

Tools

Databricks

AWS

Python

TensorFlow

PyTorch

Job description

About Definitive Healthcare :

At Definitive Healthcare (NASDAQ: DH), we're passionate about turning data, analytics, and expertise into meaningful intelligence that helps our customers achieve success and shape the future of healthcare. We empower them to uncover the right markets, opportunities, and people-paving the way for smarter decisions and greater impact.

Headquartered just outside of Boston, Massachusetts, Definitive Healthcare operates across North America, Europe, and India, supporting a growing global client base of more than 2,400 customers since our founding in 2011.

We're also a great place to work. In 2024 and 2025, we earned multiple workplace honors, including Built In's 100 Best Places to Work in Boston (both years), a Stevie Bronze Award for Great Employers, and recognition as a Great Place to Work in India.

We foster a collaborative, inclusive culture where diverse perspectives drive innovation. Through programs like DefinitiveCares and our employee-led affinity groups we strive to promote connection, education, and inclusion.

About the Role

We are seeking a hands-on Principal MLOps Engineer & Functional Lead to architect, build, and scale our next-generation Machine Learning and Generative AI infrastructure. In this role, you will design a unified, automated, and secure AI ecosystem capable of training and deploying both traditional predictive models and advanced Generative/Agentic AI systems at enterprise scale.

As the Functional Lead, you will drive engineering excellence, establish MLOps best practices across the organization, mentor senior engineers, and translate strategic business objectives into robust, highly scalable automated pipelines.

What You'll Do

• Design, implement, and maintain scalable, robust ML pipelines and data pipelines for CI/CD, and ML model deployments.
• Architect and govern the enterprise feature store and vector store infrastructure to support low-latency feature retrieval for both traditional ML and Retrieval Augmented Generation (RAG) applications.
• Build and manage enterprise-grade workflow orchestration layers to schedule, monitor, and manage complex, multi-stage model training and data processing dependencies.
• Be a subject matter expert for Generative AI infrastructure, building scalable frameworks to support advanced LLM applications, RAG pipelines, and multi-agent Agentic AI workflows.
• Establish highly efficient environments for model training and parameter-efficient fine-tuning of open-source and proprietary models.
• Optimize high-throughput, low-latency model inference pipelines, utilizing advanced caching and compute distribution techniques to handle large-scale concurrent requests.
• Establish and enforce lifecycle management policies utilizing an enterprise model registry to manage version control, lineage, and tracking from experimentation to production.
• Architect high-performing, cost-efficient infrastructure utilizing autoscaling groups on AWS to dynamically handle varying training and inference workloads.
• Implement comprehensive, real-time endpoint monitoring systems to track model performance, data drift, latency, and system health metrics.
• Serve as the functional lead for ML engineering, defining coding standards, architectural blueprints, framework selections, and operational SLAs.
• Provide technical guidance, code reviews, and mentorship to senior machine learning and data engineers, fostering an agile culture of innovation, automation, and continuous improvement.

What You'll Bring

• Bachelor's or Master's degree in Computer Science, Computer Engineering, Data Science, or a closely related quantitative engineering discipline.
• 12+ years of professional experience in data engineering, ML engineering with a minimum of 5 years dedicated to building, scaling, and managing MLOps platforms in production.
• Deep, hands-on production experience architecting with in Databricks and native Aws environments.
• Expert proficiency in Python, with strong production experience deploying models built in TensorFlow and PyTorch.

Compensation and Benefits

The salary range for this position is $158,000 - $294,000 per year, which represents the base pay the company reasonably and in good faith expects to pay for this role. Actual pay within this range will be determined based on factors such as relevant experience, skills, and qualifications.

Depending on the position, employees may also be eligible to participate in a company bonus or commission plan. All employees are eligible for a comprehensive benefits package, including medical, dental, and vision coverage, unlimited paid time off, and participation in the company's 401(k) plan with employer contribution.

• medical
• dental
• vision coverage
• unlimited paid time off
• participation in the company's 401(k) plan with employer contribution

Why we love Definitive, and why you will too!

• Industry leading products
• Work hard, and have fun doing it
• Incredibly fast growth means limitless opportunity
• Flexible and dynamic culture
• Work alongside some of the most talented and dedicated teammates
• Definitive Cares, our community serv