MLOps / AIOps / LLMOps / AgentOps Engineer

FinOps Weekly; Northern (KY); Hybrid; USD 120,000 - 160,000; Full time

Job summary

FinOps Weekly is seeking an experienced MLOps/AIOps/LLMOps/AgentOps Engineer to design, operate, and evolve our AI platforms in production across AWS and Azure environments.

You will focus on platform reliability, automation, observability, and scalable pipelines, collaborating with data scientists and engineers to productionize AI solutions. Fluency in English and strong cloud/DevOps skills are essential.

Qualifications

• Hands-on experience in MLOps, AIOps, or operating ML systems in production.
• Strong knowledge of LLMOps and AgentOps concepts (RAGs, agents, evaluation, monitoring).
• Experience with AWS and/or Azure in production environments.
• Experience with containers and Kubernetes (Docker, Helm).
• Experience with CI/CD pipelines (GitHub Actions, GitLab CI, Azure DevOps, Jenkins).
• Familiarity with observability and monitoring concepts (CloudWatch, OpenTelemetry, Prometheus).
• Experience managing infrastructure as code (Terraform, Bicep, CDK, or similar).
• Python and ML ecosystem (scikit-learn, PyTorch).

Responsibilities

• Design, maintain, and evolve the AIOps platform supporting: traditional ML models in production.
• Develop and operate ML and LLM pipelines with focus on reliability and observability.
• Implement cost control and optimization for AI workloads.
• Collaborate with Data Scientists/Engineers to productionize AI solutions.

Skills

MLOps

AIOps

LLMOps

AgentOps

AWS

Azure

Kubernetes

Docker

CI/CD

Observability

IaC

Python

ML lifecycle

English

Tools

Docker

Kubernetes

Terraform

CloudFormation

Bicep

CDK

GitHub Actions

GitLab CI

Azure DevOps

Helm

Job description

# MLOps / AIOps / LLMOps / AgentOps EngineerUnited StatesFinOpsNot Specified18/05/2026OtherRemoteFavoriteAccess Job## Job DescriptionWe are looking for a MLOps / AIOps / LLMOps / AgentOps Engineer to join a multidisciplinary Data & AI team. The main mission of this role is to design, operate, and continuously evolve our AIOps platform , ensuring that our AI products run in a reliable, scalable, and cost‐efficient way. This position is strongly focused on platform, infrastructure, automation, observability, and operations rather than on building ML models or AI products themselves. You will work with modern cloud technologies (mainly AWS , with some Azure exposure) and collaborate closely with Data Scientists, Data Engineers, and Product teams to bring AI solutions into production and keep them running smoothly. We are open to candidates with strong expertise in at least one core area (e.g. cloud, DevOps, platform engineering, or ML operations) and solid foundational knowledge in the others , with motivation to grow across the full AI operations stack. Key Responsibilities Design, maintain, and evolve the AIOps platform supporting: Traditional machine learning models in production LLM‐based solutions such as RAG pipelines and AI Agents Speech Analytics use cases (ASR, conversation analysis, NLP) Build and operate ML and LLM pipelines with a strong focus on: Reliability, automation, and observability Model and LLM quality, performance, and drift monitoring Cloud cost control and optimization Implement LLMOps / AgentOps practices, including: LLM evaluation and observability Prompt management, traceability, and specialized logging Agent integration, orchestration, and lifecycle management Ensure continuous operation of AI products, including: Alerts, dashboards, SLOs / SLIs Scalability strategies and basic auto‐remediation mechanisms Manage deployments in cloud environments (AWS / Azure) and container platforms (Docker / Kubernetes) Collaborate closely with Data Scientists and Data Engineers to productionize robust, scalable AI solutions Contribute to internal standards, automation, and best practices across the AI and data ecosystem Required Skills (Must Have) Hands‐on experience in MLOps, AIOps, or operating ML systems in production Solid understanding of LLMOps and AgentOps concepts (RAGs, agents, evaluation, monitoring) Experience working with AWS and/or Azure in production environments Practical knowledge of containers and Kubernetes (Docker, basic Helm usage, etc.) Experience with CI/CD pipelines (GitHub Actions, GitLab CI, Azure DevOps, Jenkins, or similar) Familiarity with observability and monitoring concepts (CloudWatch, OpenTelemetry, Prometheus, etc.) Experience managing infrastructure as code (Terraform, Bicep, CDK, or similar) Python experience and familiarity with the ML ecosystem (e.g. scikit‐learn, PyTorch), even if not a Data Scientist Good understanding of the ML / LLM lifecycle, from development to production and monitoring Fluent English to work in an international environment Nice To Have (Not Required, But Valuable) Experience with ML/AI platforms such as SageMaker, Azure ML, MLflow, Kubeflow Exposure to Speech Analytics technologies (ASR, diarization, conversational NLP) Experience with cloud cost optimization / FinOps, especially for AI workloads Experience building or operating AI agents, copilots, or conversational systems Familiarity with LLM frameworks (LangChain, LlamaIndex, Semantic Kernel, etc.) Experience with workflow and orchestration tools (Airflow, Argo, Step Functions, Durable Functions) Professional Skills & Mindset Strong focus on reliability, automation, and scalability Ability to collaborate effectively in multidisciplinary teams Clear communication and documentation‐oriented mindset Platform mindset: building reusable, maintainable, and robust solutions Proactive, analytical, and continuous‐improvement driven Strong sense of ownership and end‐to‐end responsibility Motivation to learn and grow across the AI operations stack Technology Environment Cloud: AWS, Azure Orchestration & Containers: Kubernetes, Docker CI/CD: GitHub Actions, GitLab CI, Azure DevOps Observability: Prometheus, Grafana, ELK/EFK, OpenTelemetry Infrastructure as Code: Terraform, Bicep, CloudFormation AI / ML Tools: MLflow, Azure ML, SageMaker, LangChain, LlamaIndex, Semantic Kernel Primary Language: Python