Senior LLMOps Engineer: Production AI & Observability

Paycom - ATS; United States; Remote; USD 150,000 - 210,000; Full time

Job summary

Citrin Cooperman is seeking a Senior – MLOps/LLMOps Engineer, Development to join the Information Technology department’s Development team. You will build and operate the AI solutions backbone for production workloads with frontier models and LangGraph state machines.

Ideal candidates have 4+ years in DevOps/MLOps, strong Python, Docker/Kubernetes, and hands-on CI/CD experience using Azure DevOps, GitHub Actions, or GitLab CI. Azure/AWS cloud familiarity is a plus.

Qualifications

• Bachelor's degree in CS/IT/engineering or equivalent experience.
• Databricks Certified: Machine Learning Professional and AZ-400.
• 4+ years in DevOps, MLOps or SRE with real generative AI deployments.
• Hands-on CI/CD pipelines with Azure DevOps, GitHub Actions, GitLab CI.
• Hands-on with LLMOps tools and frameworks and containerization tech.

Responsibilities

• LLMOps CI/CD pipelines: automates deployment for generative AI apps.
• Evaluation infrastructure: LangSmith/ Braintrust or custom harnesses.
• Telemetry: monitor token costs, latency, and hallucination rates.
• Prompt & model registry: version control and auditable history.
• Guardrails: integrate input/output guardrails to block misuse.
• FinOps: monitor token usage and optimize AI tooling costs.

Skills

CI/CD pipelines

Python scripting

Observability mindset

DevOps fundamentals

Analytical troubleshooting

Education

Bachelor's degree in CS/IT/Engineering

Databricks ML Professional

Azure DevOps Engineer Expert (AZ-400)

MLOps DeepLearning.AI certification

Tools

Azure DevOps

GitHub Actions

GitLab CI

MLflow

LangSmith

PromptFlow

Arize

LangGraph

Docker

Kubernetes

LangChain

Azure

AWS

IaC (infrastructure as code)

OpenAI / Anthropic / Google Vertex AI ecosystem

Job description

Citrin Cooperman is seeking a Senior – MLOps/LLMOps Engineer, Development to join the Information Technology department’s Development team. You will build and operate the AI solutions backbone for production workloads with frontier models and LangGraph state machines.

Ideal candidates have 4+ years in DevOps/MLOps, strong Python, Docker/Kubernetes, and hands-on CI/CD experience using Azure DevOps, GitHub Actions, or GitLab CI. Azure/AWS cloud familiarity is a plus.