MLOps Engineer: LLM Apps & AI Infra

Zone 5 Technologies; United States; Remote; USD 140,000 - 175,000; Full time

Benefits offered by this job

Medical, dental, vision benefits

401k with company-match

4 weeks paid time off

12 company holidays

Job summary

Zone 5 Technologies is seeking an experienced MLOps Engineer in the United States to build LLM-powered applications and tools. You will design agentic workflows, scale RAG systems, and connect LLMs to internal data sources on Kubernetes, ensuring security and reliable production deployment.

You will contribute to AI infrastructure, data operations, and CI/CD pipelines while collaborating across teams to ship new capabilities for unmanned aircraft technology.

Qualifications

• Bachelor's in Computer Science, Software Engineering, Data Engineering, or related field – equivalent industry experience welcome.
• 3–6+ years of experience in MLOps, software, platform, or backend engineering; depth matters more than years.
• Strong proficiency in Python and building, shipping, and operating services.
• Experience building LLM-powered applications with LLM APIs or self-hosted models, prompts, and tool/function calling.
• Hands-on experience with Kubernetes and containerized deployment.
• Solid understanding of CI/CD, infrastructure-as-code, and production service reliability.
• Awareness of access control and data-boundary concerns when connecting tools to sensitive internal systems.
• Ability to learn quickly and work across unfamiliar parts of the stack.
• Depth in LLM development, RAG/retrieval, agent design, or AI infra.

Responsibilities

• Design and build LLM-powered tools and agentic workflows to automate real work and raise productivity.
• Extend and improve RAG systems: ingestion, chunking, embedding, retrieval, ranking, evaluation.
• Structure retrieval around organizational hierarchy to improve relevance and access boundaries.
• Build tool integrations connecting LLMs to internal systems and data sources.
• Design agents with guardrails and safe behavior for real systems.
• Establish testing frameworks to measure quality and guide iteration.
• Collaborate with teams to identify high-value use cases and deploy tools.

Skills

Python

LLM APIs

Kubernetes

CI/CD

Production services

Education

Bachelor's in CS/Software Engineering/Data Engineering

Tools

pgvector

Qdrant

Weaviate

Milvus

LangChain

LlamaIndex

Job description

Zone 5 Technologies is seeking an experienced MLOps Engineer in the United States to build LLM-powered applications and tools. You will design agentic workflows, scale RAG systems, and connect LLMs to internal data sources on Kubernetes, ensuring security and reliable production deployment.

You will contribute to AI infrastructure, data operations, and CI/CD pipelines while collaborating across teams to ship new capabilities for unmanned aircraft technology.