On-Site Senior MLOps Engineer: Real-Time LLM Infra

Nace.AI; Palo Alto (CA); On-site; USD 210,000 - 280,000; Full time

Job summary

Nace AI in Palo Alto, CA is seeking a Senior MLOps Engineer to own the production-grade ML infrastructure that turns research into reliable systems. You will design and operate training orchestration, model registries, CI/CD for models, and automated evaluation pipelines across cloud and on-prem environments.

You'll lead LLM/SLM serving, scale low-latency inference with vLLM and related tooling, manage multi-GPU clusters, and implement observability and audit-ready controls to support enterprise

Qualifications

• 5+ years of experience in MLOps, ML infrastructure, or platform engineering.
• Proven experience deploying and scaling LLM/inference infrastructure in production, including model serving frameworks.
• Strong proficiency with Kubernetes, Docker, and infrastructure-as-code (Terraform or similar).
• Hands-on experience with GPU cluster management and distributed training/serving environments.
• Proficient in Python with a track record of building substantial, maintainable systems.
• Experience with ML pipelines and orchestration tools (Airflow, Kubeflow, Ray, MLflow, Weights & Biases).

Responsibilities

• Design, build, and operate end-to-end ML infrastructure including training orchestration and evaluation pipelines.
• Own LLM/SLM serving infrastructure to achieve low latency and high throughput.
• Manage multi-GPU training and inference clusters across cloud and on-prem environments.
• Implement observability: latency, throughput, drift, and alerting for models in production.
• Harden stack for enterprise deployment: reproducibility, versioning, access controls, auditability.
• Set MLOps best practices and tooling standards as a senior member of the team.

Skills

MLOps

ML infrastructure

Kubernetes

Python

Distributed training

GPU cluster management

CI/CD for models

Observability

Education

BS in CS or related field

MS in CS or related field

Tools

Docker

Terraform

Airflow

Kubeflow

Ray

MLflow

Weights & Biases

Spark

Job description

Nace AI in Palo Alto, CA is seeking a Senior MLOps Engineer to own the production-grade ML infrastructure that turns research into reliable systems. You will design and operate training orchestration, model registries, CI/CD for models, and automated evaluation pipelines across cloud and on-prem environments.

You'll lead LLM/SLM serving, scale low-latency inference with vLLM and related tooling, manage multi-GPU clusters, and implement observability and audit-ready controls to support enterprise