LLM Ops Engineer: Build Secure AI Platform & Scale

PVH (Tommy Hilfiger/Calvin Klein); Denver (CO); Hybrid; USD 105,000 - 130,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with company match

Incentive programs

Job summary

Litera is seeking an LLM Ops Engineer in a hybrid Denver-based role. You will build and run a scalable AI platform enabling teams to deploy models across providers while ensuring security, governance, and cost efficiency.

You will work with OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, and Vertex AI, implementing high availability and observability. Join a fast-paced organization focused on AI-enabled legal technology.

Qualifications

• 3+ years in DevOps/Platform/MLOps with hands-on production LLMs.
• Experience deploying, managing, and scaling models across multiple AI providers.
• Strong Python programming skills; building scalable, secure infrastructure.

Responsibilities

• Build and operate a scalable AI platform to access and deploy models across providers and environments.
• Ensure high availability and resiliency of AI services with production-grade infra.
• Establish secure AI operations with governance, data protection, and access controls.
• Provide a unified developer experience via APIs, self-service tooling, and best practices.
• Optimize platform performance, reliability, and cost through monitoring and provider strategy management.
• Lead evaluation of emerging AI tech and scalable solutions for Litera.

Skills

DevOps

Platform Engineering

MLOps

Python programming

Tools

OpenAI

Anthropic

Azure OpenAI

AWS Bedrock

Google Vertex AI

Kubeflow

MLflow

Apache Airflow

Kubernetes

IaC

Job description

Litera is seeking an LLM Ops Engineer in a hybrid Denver-based role. You will build and run a scalable AI platform enabling teams to deploy models across providers while ensuring security, governance, and cost efficiency.

You will work with OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, and Vertex AI, implementing high availability and observability. Join a fast-paced organization focused on AI-enabled legal technology.