Staff AI Architect – Agentic Systems & LLMOps (Remote)

shifttechnology; United States; Hybrid; USD 170,000 - 250,000; Full time

Benefits offered by this job

Flexible remote and hybrid options

Learning & development sessions

Generous PTO and holidays

Mental health benefits

Volunteering days

Job summary

Shift Technology seeks a senior, hands-on engineer to shape the architecture of agentic AI systems for an insurance-focused SaaS platform. You will design, prototype, and ship next-generation AI capabilities while mentoring teams and driving technical strategy, yet remaining deeply involved in coding.

You will build production-ready agentic workflows, convert prototypes into low-latency microservices on a major cloud platform, and integrate advanced RAG patterns, vector pipelines, and structured

Qualifications

• Hands-on experience with agentic frameworks (LangGraph, LlamaIndex, OpenAI Agents SDK, Microsoft Agent Framework) or similar orchestration.
• Experience with Model Context Protocol, tool/function calling, structured LLM outputs, and complex RAG pipelines.
• LLMOps tooling experience: evaluation, tracing, prompt engineering, and governance in production.
• Strong Python and OO programming for AI ecosystem projects.
• Backend microservices and REST/OpenAPI endpoints on enterprise cloud (Azure preferred).
• Familiarity with vector/relational databases, event-driven patterns, Docker/Kubernetes, CI/CD, and infra-as-code.

Responsibilities

• Design and build production-grade agentic workflows, orchestration layers, and tool-calling integrations.
• Transition AI prototypes into low-latency microservices on a major cloud platform.
• Integrate Model Context Protocol, RAG, vector pipelines, and structured LLM outputs into production.
• Establish LLMOps: experiment tracking, evaluation, latency optimization, token governance, observability.
• Mentor engineers, lead design reviews, set coding standards, and raise AI engineering capability.
• Benchmark new models/tools and translate breakthroughs into product value.

Skills

Python

Agentic frameworks

LLM frameworks

OO programming

Backend microservices

REST/OpenAPI

Cloud deployment

Tools

LangGraph

LlamaIndex

OpenAI Agents SDK

Microsoft Agent Framework

Docker

Kubernetes

Azure

Job description

Shift Technology seeks a senior, hands-on engineer to shape the architecture of agentic AI systems for an insurance-focused SaaS platform. You will design, prototype, and ship next-generation AI capabilities while mentoring teams and driving technical strategy, yet remaining deeply involved in coding.

You will build production-ready agentic workflows, convert prototypes into low-latency microservices on a major cloud platform, and integrate advanced RAG patterns, vector pipelines, and structured