MLOps Engineer, LLM Apps & AI Infra

Zone 5 Tech; United States; On-site; USD 140,000 - 175,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Life insurance

401k with company-match

4 weeks PTO

12 company holidays

Job summary

Zone 5 Technologies is hiring a dedicated MLOps Engineer to build AI-powered capabilities, including retrieval-augmented generation, tool integrations, and agentic workflows. You’ll ship new capabilities that enable teams across the company to rely on reliable services.

This builder's role emphasizes LLM application development, retrieval quality, and agent design. The role spans a broad stack; we welcome both generalists and specialists.

Qualifications

• Bachelor's in CS, SWE, data engineering, or related field; equivalent industry experience welcome.
• 3–6+ years in MLOps, software, platform, or backend engineering (depth matters more than years).
• Strong proficiency in Python and shipping, operating services.
• Experience building LLM-powered applications—LLM APIs or self-hosted models.
• Hands-on Kubernetes and containerized deployment.
• Solid understanding of CI/CD, infrastructure-as-code, and production reliability.
• Awareness of access control and data-boundary concerns when connecting tools to sensitive systems.
• Demontrates ability to learn quickly across the stack and grow in areas.
• Depth in at least one core area (LLM app development, RAG, agent design, or AI infra).

Responsibilities

• Design and build LLM-powered tools and agentic workflows that automate real work.
• Extend and improve RAG systems: ingestion, embedding, retrieval, ranking, evaluation.
• Structure retrieval around information hierarchy to improve relevance and access.
• Build tool integrations that connect LLMs to internal systems and data sources.
• Design agents with guardrails and human-in-the-loop where warranted.
• Establish evaluation and testing frameworks to measure quality and regressions.
• Partner with teams to identify high-value use cases and deploy tools.

Skills

LLM apps

RAG retrieval

Agent design

Python

Kubernetes

CI/CD

Infrastructure-as-code

Security boundaries

Learning agility

Cross-functional collaboration

Education

Bachelor's in Computer Science, Software Engineering, Data Engineering, or related field

Tools

LangChain

Weaviate

Job description

Zone 5 Technologies is hiring a dedicated MLOps Engineer to build AI-powered capabilities, including retrieval-augmented generation, tool integrations, and agentic workflows. You’ll ship new capabilities that enable teams across the company to rely on reliable services.

This builder's role emphasizes LLM application development, retrieval quality, and agent design. The role spans a broad stack; we welcome both generalists and specialists.