Senior Machine Learning Engineer – MLOps & LLMOps

ZoomInfo; United States; Remote; USD 180,000 - 248,000; Full time

Job summary

Join an innovative company as a Senior Machine Learning Engineer, where you will architect the MLOps stack that powers cutting-edge AI solutions for thousands of customers. This role offers the opportunity to work with advanced technologies and lead initiatives that significantly impact business outcomes. You will collaborate with talented teams to optimize machine learning workflows and ensure the reliability of AI systems. With a culture that values creativity and accountability, this position is perfect for those eager to make a difference in the AI landscape while enjoying competitive pay and comprehensive benefits.

Benefits

Flexible location

Professional growth opportunities

Comprehensive benefits

Holistic wellness programs

Equity options

Qualifications

• 7+ years of experience in building production ML systems.
• Deep expertise in modern MLOps/LLMOps and distributed systems.
• Exceptional communication skills to align teams around data-driven decisions.

Responsibilities

• Architect the end-to-end MLOps stack for training and serving LLMs.
• Design cost-aware training workflows to optimize performance and costs.
• Lead CI/CD best practices and mentor engineers in the team.

Skills

MLOps

Python

Machine Learning

Kubernetes

Docker

Distributed Computing

Entity Resolution

Graph Data Stores

Communication Skills

Education

PhD in Computer Science

Master's in Computer Science

Tools

MLFlow

Ray

Terraform

Pinecone

Neo4j

Job description

At ZoomInfo, we encourage creativity, value innovation, demand teamwork, expect accountability and cherish results. We value your take charge, take initiative, get stuff done attitude and will help you unlock your growth potential. One great choice can change everything. Thrive with us at ZoomInfo.

At ZoomInfo we turn billions of data points into instant go-to-market answers for 40,000+ customers. To keep that edge, we’re building an elite Applied AI platform that scales from first experiment to planet-scale production—securely, cost-effectively, and fast. Join us as a Senior Machine Learning Engineer and own the MLOps & LLMOps backbone that powers our retrieval, recommendation, and knowledge-graph products.

What you will do:

• Architect the end-to-end MLOps / LLMOps stack (Kubernetes, Ray, Argo, Terraform, MLFlow, Feature & Model Stores) for training, fine-tuning, and serving LLMs, RAG pipelines, NER, and entity-resolution models at multi-billion-record scale.
• Design cost-aware training & inference workflows—automatic mixed precision, quantization, distillation, dynamic batching, on-demand GPU/CPU autoscaling—to cut $/call and CO₂ while meeting 99.9% SLAs.
• Build iron-clad evaluation & safety frameworks: red-teaming, hallucination scoring, PII/toxicity filters, guardrail policies, shadow deployments, and continuous regression tests.
• Fine-tune embedding models and pre-train domain-specific LLMs on ZoomInfo corpora; integrate with vector databases (Pinecone, Milvus, OpenSearch) to power RAG search and recommender systems.
• Prototype and benchmark emerging AI/infra tech (parameter-efficient tuning, retrieval frameworks, serverless GPUs) against incumbent solutions; present clear “buy-build-borrow” recommendations.
• Model, build, and optimize knowledge graphs—schema design, entity linking, incremental updates—to supercharge retrieval and recommendation accuracy.
• Profile and re-architect RAG, NER, and entity-resolution services for sub-100 ms latency, 5× QPS jumps, and zero-downtime deploys across global regions.
• Lead multi-team CI/CD best practices—blue/green, canary, GitOps—and large-scale A/B tests to quantify revenue impact.
• Mentor engineers, publish internal playbooks & external blogs, and speak at industry forums to cement ZoomInfo’s technical leadership.

What you bring:

• 7+ years building production ML systems (or 4+ post-PhD/MS) with at least two at 100M+ user or record scale.
• Deep expertise in modern MLOps/LLMOps (K8s, Docker, MLFlow/Vertex AI/SageMaker, Kubeflow, Airflow, ArgoCD, model registries).
• Proven record optimizing LLMs/SLMs via quantization, LoRA/PEFT, distillation, and distributed training (DeepSpeed, FSDP, Hugging Face, TensorRT-LLM).
• Strong software-engineering fundamentals in Python and experience with distributed computing infrastructure such as Spark and Ray based jobs and pipelines
• Hands-on mastery of vector search & RAG patterns, entity-resolution algorithms, and graph data stores (Neo4j, Neptune, JanusGraph, Spanner Graph) is a major plus.
• Fluency in cost, reliability, security, and compliance trade-offs; comfortable providing inputs to budgets and setting SLOs.
• Exceptional communication skills—able to align executives, PMs, Data Scientists and engineers around data-driven decisions.

Why ZoomInfo?

• Own infrastructure that touches billions of documents, millions of daily requests, and nine-figure revenue lines.
• Green-field influence: choose the stack, set the guardrails, and define best practices that shape our next-gen AI platform.
• Culture that rewards initiative, collaboration, ships quickly, invests heavily in professional growth.
• Competitive pay, equity, and benefits; flexible location (US hubs, or remote within US and Canada. Candidate needs to be living in the USA or Canada).

Ready to industrialize AI at scale? Apply now and build the backbone of ZoomInfo’s next era of intelligent products.

#LI-VC1

#LI-Remote

Actual compensation offered will be based on factors such as the candidate’s work location, qualifications, skills, experience and/or training. Your recruiter can share more information about the specific salary range for your desired work location during the hiring process. We want our employees and their families to thrive.

In addition to comprehensive benefits we offer holistic mind, body and lifestyle programs designed for overall well-being. Learn more about ZoomInfo benefits here.

Below is the US base salary for this position. Additional compensation such as Bonus, Commission, Equity and other benefits may also apply.

$180,000—$247,500 USD

About us:

ZoomInfo (NASDAQ: ZI) is the Go-To-Market Intelligence Platform that empowers businesses to grow faster with AI-ready insights, trusted data, and advanced automation. Its solutions provide more than 35,000 companies worldwide with a complete view of their customers, making every seller their best seller.

ZoomInfo may use a software-based assessment as part of the recruitment process. More information about this tool, including the results of the most recent bias audit, is availablehere.

ZoomInfo is proud to be an equal opportunity employer, hiring based on qualifications, merit, and business needs, and does not discriminate based on protected status. We welcome all applicants and are committed to providing equal employment opportunities regardless of sex, race, age, color, national origin, sexual orientation, gender identity, marital status, disability status, religion, protected military or veteran status, medical condition, or any other characteristic protected by applicable law. We also consider qualified candidates with criminal histories in accordance with legal requirements.