LLM Ops Engineer

Litera; Denver (CO); On-site; USD 105,000 - 130,000; Full time

Benefits offered by this job

Medical, dental, vision

401(k) with company match

Incentive programs

Job summary

Litera is seeking an LLM Ops Engineer in a hybrid Denver-based role. You will build and run a scalable AI platform enabling teams to deploy models across providers while ensuring security, governance, and cost efficiency.

You will work with OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, and Vertex AI, implementing high availability and observability. Join a fast-paced organization focused on AI-enabled legal technology.

Qualifications

• 3+ years in DevOps/Platform/MLOps with hands-on production LLMs.
• Experience deploying, managing, and scaling models across multiple AI providers.
• Strong Python programming skills; building scalable, secure infrastructure.

Responsibilities

• Build and operate a scalable AI platform to access and deploy models across providers and environments.
• Ensure high availability and resiliency of AI services with production-grade infra.
• Establish secure AI operations with governance, data protection, and access controls.
• Provide a unified developer experience via APIs, self-service tooling, and best practices.
• Optimize platform performance, reliability, and cost through monitoring and provider strategy management.
• Lead evaluation of emerging AI tech and scalable solutions for Litera.

Skills

DevOps

Platform Engineering

MLOps

Python programming

Tools

OpenAI

Anthropic

Azure OpenAI

AWS Bedrock

Google Vertex AI

Kubeflow

MLflow

Apache Airflow

Kubernetes

IaC

Job description

Where You'll Work

This is a hybrid role based in Denver, CO with the expectations to be in office at least 3 days a week for collaboration and connection.

Why this Role Matters

At Litera, AI is becoming a critical enabler of how we build products, improve customer experiences, and drive innovation. As an LLM Ops Engineer, you will create the secure, scalable, and reliable foundation that allows our engineering teams to leverage AI confidently and efficiently across the business. Your work will ensure that AI capabilities are available, governed, cost-effective, and ready to support production applications at scale. This role is instrumental in accelerating AI adoption while maintaining the performance, security, and resilience required for enterprise software.

What You'll Deliver

• Build and operate a scalable AI platform that enables engineering teams to seamlessly access and deploy models across multiple providers and environments.
• Ensure high availability and resiliency of AI services through intelligent routing, failover strategies, and production-grade infrastructure.
• Establish secure and compliant AI operations by protecting model access, safeguarding sensitive data, and enforcing governance standards.
• Create a consistent developer experience through unified APIs, self-service capabilities, tooling, and best practices that accelerate AI adoption.
• Optimize AI platform performance, reliability, and cost efficiency through proactive monitoring, analytics, and provider strategy management.
• Lead the evolution of Litera's AI operations capabilities by evaluating emerging technologies and recommending scalable solutions.
• Deliver observability and operational excellence through dashboards, alerting, quality monitoring, and service-level metrics.
• Support the safe deployment of AI solutions by implementing testing frameworks, quality controls, and production readiness standards.

What You'll Bring

Must-Haves:

• 3+ years of experience in DevOps, Platform Engineering, MLOps, or a related field, including hands-on experience operating LLMs in production environments.
• Experience deploying, managing, and scaling models across multiple AI providers such as OpenAI, Anthropic, Azure OpenAI, AWS Bedrock, or Google Vertex AI.
• Strong expertise in building highly available, secure infrastructure, including load balancing, failover strategies, secrets management, and access controls.
• Experience with API management, gateway technologies, and production-grade AI service operations.
• Strong Python programming skills with experience developing and supporting scalable systems.
• Proven ability to solve complex technical challenges and thrive in a fast-paced, evolving environment while collaborating across teams.

Nice to Haves:

• Experience fine-tuning or training large language models for domain-specific applications.
• Familiarity with ML orchestration tools and frameworks such as Kubeflow, MLflow, or Apache Airflow.
• Experience with LLM evaluation frameworks, retrieval-augmented generation (RAG), vector databases, or inference optimization techniques.
• Knowledge of infrastructure-as-code, Kubernetes, compliance frameworks, or large-scale AI cost optimization strategies.

What You'll Experience

• A team that shows up. Work alongside people who collaborate, support one another, and lead with integrity.
• Global Reach. Partner with teams around the world to solve complex challenges that matter.
• Real opportunity for growth. Expand your impact through meaningful stretch opportunities, visibility and career development.
• AI-driven innovation. Work at the intersection of legal technology, customer outcomes, and cutting-edge AI.

Pay Transparency for Colorado Applicants

The base salary range for this role is $105,000 to $130,000 USD. Final compensation will be determined based on experience, skills, education, and other relevant qualifications.

This role is also eligible to participate in a company bonus plan. In addition to base salary, Litera offers a comprehensive benefits package, including medical, dental, and vision coverage, a 401(k) with company match, and incentive and recognition programs. Benefits are subject to eligibility requirements.

#LI-Hybrid

Litera is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive