Senior LLMOps Engineer: Scale AI Infra & Governance

TRM Labs; United States; Hybrid; USD 200,000 - 275,000; Full time

Benefits offered by this job

Equity plan

Job summary

TRM Labs, a US-based AI safety company, is seeking a Senior MLOps Engineer with a focus in LLMOps to build and scale our AI/ML infrastructure. You will design reusable CI/CD workflows for model training, evaluation, and deployment, and collaborate with data science to embed models into real-time applications and workflows.

The role emphasizes governance, cost monitoring, offline/online evaluation, and reliability.

Qualifications

• Proficiency in Python and building scalable infrastructure.
• Experience with ML Ops, model versioning, and drift detection.
• Ability to deploy and monitor AI/ML systems in production.

Responsibilities

• Build reusable CI/CD workflows for model training, evaluation, and deployment.
• Automate model versioning, approvals, and compliance across environments.
• Develop scalable AI infrastructure with vector databases, feature stores, and observability tooling.

Skills

Python

CI/CD

Cloud infrastructure

LLMOps

Docker

Kubernetes

Terraform

Monitoring

OpenTelemetry

Tools

Langfuse

LangChain

vLLM

Triton

BentoML

MLflow

Datadog

Prometheus

Terraform

Job description

TRM Labs, a US-based AI safety company, is seeking a Senior MLOps Engineer with a focus in LLMOps to build and scale our AI/ML infrastructure. You will design reusable CI/CD workflows for model training, evaluation, and deployment, and collaborate with data science to embed models into real-time applications and workflows.

The role emphasizes governance, cost monitoring, offline/online evaluation, and reliability.