AI Platform Architect – LLM, RAG & Infra Lead (Remote)

iSolved HCM; Charlotte (NC); Hybrid; USD 170,000 - 210,000; Full time

Job summary

isolved is a leading provider of human capital management (HCM) solutions that blends modern technology with expert services and support. The Senior Software Engineer, AI Platform role owns both program execution and technical direction, leading ~20 engineers across domain teams (Tax, Benefits, Time, Payroll, Shared Logic), alongside two Engineering Managers and a Data Architect.

The position blends delivery leadership with deep technical involvement, serving as a key decision-maker, escalation

Qualifications

• 5+ years of professional software engineering experience, with Python as your primary language.
• 2+ years building production LLM-powered systems - inference, RAG, agentic patterns, or AI infrastructure
• Deep Python expertise - primary language for AI platform work; strong C#/.NET interop

Responsibilities

• Design and build a scalable LLM gateway with model routing, prompt management, cost attribution, rate limiting, and caching
• Develop and operate RAG pipelines, embedding services, and vector search infrastructure for platform-wide use
• Implement platform-level cost optimization strategies, including semantic caching and model selection by workload
• Build and maintain agentic runtime infrastructure, including orchestration, state management, and human-in-the-loop patterns
• Develop extensible MCP server and tool ecosystems for product team integration
• Design and support multi-agent coordination patterns using modern frameworks and protocols
• Establish comprehensive AI observability, including usage, latency, cost tracking, and distributed tracing
• Implement AI governance controls, including access management, audit logging, content filtering, and security protections
• Build AI incident detection and response capabilities, including monitoring for failures, hallucinations, and cost anomalies
• Create developer-friendly SDKs across languages (Python, .NET, TypeScript) to simplify platform adoption
• Define "paved road" patterns for common AI use cases and support onboarding of product teams
• Build automated evaluation pipelines and continuously monitor production quality and model performance

Skills

Python

C# / .NET

LangChain

LangGraph

Semantic Kernel

RAG architecture

Azure AI Foundry / Azure OpenAI

LLM-powered systems

Observability

Tools

Azure Container Apps

Terraform

Job description

isolved is a leading provider of human capital management (HCM) solutions that blends modern technology with expert services and support. The Senior Software Engineer, AI Platform role owns both program execution and technical direction, leading ~20 engineers across domain teams (Tax, Benefits, Time, Payroll, Shared Logic), alongside two Engineering Managers and a Data Architect.

The position blends delivery leadership with deep technical involvement, serving as a key decision-maker, escalation