Senior AI/ML Engineer

Prodapt; St. Louis (MO); On-site; USD 130,000 - 210,000; Full time

Job summary

Prodapt, a leading AI-first technology partner, seeks an experienced AI/ML Developer to design, build, and deploy LLM-powered agents for field technicians. You will join the agentic platform team and contribute to the core multi-agent orchestration system.

This onsite role requires strong Python expertise, 10+ years in software development, and 2+ years in LLM development. You will implement RAG pipelines, tool-calling agents, real-time streaming, and Azure OpenAI integrations.

Qualifications

• 10+ years of software development in production with Python.
• 2+ years of hands-on LLM development using LangChain, LangGraph, or equivalent.
• Experience building RAG pipelines with embeddings, vector search, and re-ranking.
• Experience with OpenAI Chat API, streaming responses, and tool calling.
• Proficient with PostgreSQL and async ORMs (SQLAlchemy async / Alembic).

Responsibilities

• Design and develop LLM-powered agents using LangGraph and LangChain.
• Build multi-agent orchestration pipelines with routing, state management, and error handling.
• Develop RAG pipelines with semantic search, re-ranking, and fusion techniques.
• Implement tool-calling agents with parallel API execution and chained enrichment.
• Enable real-time streaming (WebSocket / SSE) for conversational AI.
• Integrate with Azure OpenAI APIs with circuit breakers and fallbacks.
• Implement prompt engineering and dynamic prompt management with DB-backed caching.
• Design multi-modal AI features including image analysis.
• Write production-grade Python with logging, tests, and observability.
• Participate in code reviews and sprint delivery.

Skills

Python development

LLM development

RAG pipelines

LLM APIs

PostgreSQL async ORM

Education

Bachelor's degree in CS or IT

Tools

LangGraph

LangChain

OpenAI API

SQLAlchemy async

Job description

Prodapt is the largest specialized player in the Connectedness industry. As an AI-first strategic technology partner, Prodapt provides consulting, business reengineering, and managed services for the largest telecom and tech enterprises building networks and digital experiences of tomorrow. A ServiceNow-invested company, Prodapt has been recognized by Gartner as a Large, Telecom-Native, Regional IT Service Provider. A "Great Place To Work® Certified™" company, Prodapt employs over 5,000 technology and domain experts across the Americas, Europe, India, Africa, & Japan. Prodapt is part of the 130-year-old business conglomerate The Jhaver Group, which employs over 32,000 people across 80+ locations globally.

Job Summary

We are looking for a skilled AI/ML Developer to join our agentic platform team. You will design, develop, and deploy LLM-powered agents and pipelines that directly serve field technicians in production. You will work closely with the platform architect and contribute to the core multi-agent orchestration system.

Work Arrangement

Onsite Role - 5 days a week

Interview

Two rounds - Video interview and In-person (Final Discussion)

Key Responsibilities

• - Design and develop LLM-powered agents using LangGraph and LangChain frameworks
• - Build and enhance multi-agent orchestration pipelines with conditional routing, state management, and error recovery
• - Develop RAG pipelines with hybrid search (semantic + keyword), re-ranking, and Reciprocal Rank Fusion
• - Implement tool-calling agents with parallel API execution, sequential enrichment chains, and summarization
• - Build real-time streaming capabilities (WebSocket / SSE) for conversational AI
• - Integrate with Azure OpenAI APIs with circuit breaker patterns and fallback chains
• - Implement prompt engineering and dynamic prompt management (DB-backed with in-memory caching)
• - Design and implement multi-modal AI features (image analysis with vision models)
• - Write production-quality Python code with error handling, logging, observability, and unit tests
• - Participate in code reviews, architecture discussions, and sprint delivery

Required Skills & Experience

Must-Have

• - 10+ years of software development with strong Python expertise in production environments
• - 2+ years hands-on LLM development (LangChain, LangGraph, or equivalent frameworks)
• - RAG pipeline experience - embeddings, vector search, re-ranking, answer generation
• - LLM APIs - OpenAI Chat Completions, Responses API, streaming, tool calling- Prompt engineering - system prompts, few-shot, structured JSON output
• - PostgreSQL and async ORMs (SQLAlchemy async / Alembic)

Nice-to-Have

• - LangGraph StateGraph (conditional edges, node pipelines, compiled graphs)
• - Multi-agent systems - orchestration, routing, RBAC-based access control
• - Langfuse or similar LLM observability (tracing, token usage, latency)
• - WebSocket and SSE streaming protocols
• - Multi-modal AI (vision models, image analysis)
• - Vector databases (OpenSearch, Pinecone, pgvector)
• - Telecommunications or field service domain experience

Education

Bachelor's degree, or foreign equivalent, in Computer Science or Information Technology