Senior AI/ML Engineer - LLM Agent Orchestration

Prodapt; St. Louis (MO); On-site; USD 130,000 - 210,000; Full time

Job summary

Prodapt, a leading AI-first technology partner, seeks an experienced AI/ML Developer to design, build, and deploy LLM-powered agents for field technicians. You will join the agentic platform team and contribute to the core multi-agent orchestration system.

This onsite role requires strong Python expertise, 10+ years in software development, and 2+ years in LLM development. You will implement RAG pipelines, tool-calling agents, real-time streaming, and Azure OpenAI integrations.

Qualifications

• 10+ years of software development in production with Python.
• 2+ years of hands-on LLM development using LangChain, LangGraph, or equivalent.
• Experience building RAG pipelines with embeddings, vector search, and re-ranking.
• Experience with OpenAI Chat API, streaming responses, and tool calling.
• Proficient with PostgreSQL and async ORMs (SQLAlchemy async / Alembic).

Responsibilities

• Design and develop LLM-powered agents using LangGraph and LangChain.
• Build multi-agent orchestration pipelines with routing, state management, and error handling.
• Develop RAG pipelines with semantic search, re-ranking, and fusion techniques.
• Implement tool-calling agents with parallel API execution and chained enrichment.
• Enable real-time streaming (WebSocket / SSE) for conversational AI.
• Integrate with Azure OpenAI APIs with circuit breakers and fallbacks.
• Implement prompt engineering and dynamic prompt management with DB-backed caching.
• Design multi-modal AI features including image analysis.
• Write production-grade Python with logging, tests, and observability.
• Participate in code reviews and sprint delivery.

Skills

Python development

LLM development

RAG pipelines

LLM APIs

PostgreSQL async ORM

Education

Bachelor's degree in CS or IT

Tools

LangGraph

LangChain

OpenAI API

SQLAlchemy async

Job description

Prodapt, a leading AI-first technology partner, seeks an experienced AI/ML Developer to design, build, and deploy LLM-powered agents for field technicians. You will join the agentic platform team and contribute to the core multi-agent orchestration system.

This onsite role requires strong Python expertise, 10+ years in software development, and 2+ years in LLM development. You will implement RAG pipelines, tool-calling agents, real-time streaming, and Azure OpenAI integrations.