Senior AI Platform Engineer: LLM, RAG & Multi-Agent

iSolved HCM; Northern (KY); On-site; USD 140,000 - 190,000; Full time

Job summary

isolved seeks a Senior Software Engineer, AI Platform to lead a ~20-engineer team across Tax, Benefits, Time, Payroll and more. As a technical lead and decision-maker, you will own program outcomes and guide architecture and delivery for AI platform services.

You will design scalable LLM-based systems, implement agentic runtimes, and build developer SDKs to accelerate product teams. Collaboration with management and architects is essential.

Qualifications

• 5+ years of professional software engineering experience, with Python as your primary language.

Responsibilities

• Design and build a scalable LLM gateway with model routing and caching.
• Develop and operate RAG pipelines, and vector search infrastructure.
• Implement platform-level cost optimization, including semantic caching and model selection.
• Build and maintain agentic runtime infrastructure with orchestration and state management.
• Develop MCP server and tool ecosystems for product team integration.
• Coordinate multi-agent workflows using modern frameworks.
• Establish AI observability: usage, latency, cost tracking, tracing.
• Implement AI governance: access control, audit logging, security protections.
• Build AI incident detection and response capabilities for failures and cost anomalies.
• Create SDKs across Python, .NET, TypeScript to simplify adoption.
• Define paved road patterns for common AI use cases and onboarding.
• Build automated evaluation pipelines and monitor model performance.

Skills

Python

LLM platforms

C#/.NET

Agentic frameworks

Azure/OpenAI

Observability

SDK development

DevOps/Infra

TypeScript

AI governance

Tools

LangChain

Semantic Kernel

LangGraph

Azure OpenAI

Job description

isolved seeks a Senior Software Engineer, AI Platform to lead a ~20-engineer team across Tax, Benefits, Time, Payroll and more. As a technical lead and decision-maker, you will own program outcomes and guide architecture and delivery for AI platform services.

You will design scalable LLM-based systems, implement agentic runtimes, and build developer SDKs to accelerate product teams. Collaboration with management and architects is essential.