Senior AI/ML Engineer: LLM Agents & Orchestration

Veriipro; Maryland Heights (MO); On-site; USD 150,000 - 210,000; Full time

Job summary

Veriipro is seeking an experienced AI/ML Developer on a contractual basis to design, develop, and deploy LLM-powered agents and pipelines for field technicians. You will work closely with the platform architect on the core multi-agent orchestration system.

Requirements include 10+ years in Python, 2+ years in LLM development, RAG pipelines, and experience with LangChain/LangGraph, OpenAI APIs, and async Python. You will contribute to scalable microservices and observability in production.

Qualifications

• 10+ years of software development with strong Python in production.
• 2+ years of hands-on LLM development with LangChain/LangGraph or equivalent.
• Experience with RAG pipelines: embeddings, vector search, re-ranking, answer generation.
• Familiarity with OpenAI Chat Completions/Responses API, streaming, tool calling.
• Async Python (asyncio, httpx, FastAPI).
• Prompt engineering: system prompts, few-shot, structured JSON output.
• Circuit breaker patterns, retry logic, resilient service design.
• PostgreSQL with async ORMs (SQLAlchemy async/Alembic).
• Git, CI/CD, Docker, Kubernetes basics.
• Strong system design: microservices, distributed systems, API design.

Responsibilities

• Design and develop LLM-powered agents using LangGraph and LangChain frameworks.
• Build and enhance multi-agent orchestration pipelines with conditional routing, state management, and error recovery.
• Develop RAG pipelines with hybrid search, re-ranking, and Reciprocal Rank Fusion.
• Implement tool-calling agents with parallel API execution and sequential enrichment chains.
• Build real-time streaming capabilities (WebSocket/SSE) for conversational AI.
• Integrate with Azure OpenAI APIs with circuit breaker patterns and fallback chains.
• Implement prompt engineering and dynamic prompt management (DB-backed with in-memory caching).
• Design and implement multi-modal AI features (image analysis with vision models).
• Write production-quality Python code with error handling, logging, observability, and unit tests.
• Participate in code reviews, architecture discussions, and sprint delivery.

Skills

Python

LLM development

LangChain

LangGraph

RAG pipelines

OpenAI APIs

Async Python

Prompt engineering

Distributed systems

PostgreSQL async ORM

Docker

Kubernetes

HTTPX

FastAPI

Git

Tools

Docker

Kubernetes

SQLAlchemy

Alembic

Git

CI/CD

FastAPI

httpx

Job description

Veriipro is seeking an experienced AI/ML Developer on a contractual basis to design, develop, and deploy LLM-powered agents and pipelines for field technicians. You will work closely with the platform architect on the core multi-agent orchestration system.

Requirements include 10+ years in Python, 2+ years in LLM development, RAG pipelines, and experience with LangChain/LangGraph, OpenAI APIs, and async Python. You will contribute to scalable microservices and observability in production.