Senior AI Platform Engineer - LLM, RAG & Observability

iSolved HCM; Charlotte (NC); On-site; USD 150,000 - 210,000; Full time

Job summary

isolved is seeking a Senior Software Engineer, AI Platform to own program execution and steer a team of ~20 engineers across Tax, Benefits, Time, Payroll, and Shared Logic, with two Engineering Managers and a Data Architect.

The role blends delivery leadership with deep technical involvement, driving scalable LLM gateway design, RAG pipelines, AI observability, governance, and SDKs for Python, .NET, and TypeScript.

Qualifications

• 5+ years of professional software engineering experience, with Python as primary language.
• 2+ years building production LLM-powered systems - inference, RAG, agentic patterns, or AI infrastructure.
• Deep Python expertise as primary language for AI platform work.
• Working proficiency in C#/.NET to support interop across teams.
• Strong hands-on experience with agentic frameworks such as Semantic Kernel, LangGraph, LangChain.
• Production experience with RAG architecture: chunking, embeddings, vector search, retrieval quality, and failure modes.
• Azure AI Foundry / Azure OpenAI experience - deployment, API integration, observability tooling.
• Experience building internal platforms or SDKs that other engineers depend on.

Responsibilities

• Design and build a scalable LLM gateway with model routing, prompt management, cost attribution, rate limiting, and caching.
• Develop and operate RAG pipelines, embedding services, and vector search infrastructure.
• Implement platform-level cost optimization strategies and semantic caching.
• Build and maintain agentic runtime infrastructure, including orchestration and state management.
• Create developer-friendly SDKs across languages (Python, .NET, TypeScript).
• Define paved road patterns for common AI use cases and onboarding of product teams.
• Establish AI observability, including usage, latency, cost tracking, and distributed tracing.

Skills

Python

LLM-powered systems

C#/.NET

Agentic frameworks

Azure AI/OpenAI

Observability

SDK development

Tools

Semantic Kernel

LangGraph

LangChain

Job description

isolved is seeking a Senior Software Engineer, AI Platform to own program execution and steer a team of ~20 engineers across Tax, Benefits, Time, Payroll, and Shared Logic, with two Engineering Managers and a Data Architect.

The role blends delivery leadership with deep technical involvement, driving scalable LLM gateway design, RAG pipelines, AI observability, governance, and SDKs for Python, .NET, and TypeScript.