Senior AI Platform Architect for Production LLMs & Agents

HeartCentrix Solutions; United States; On-site; USD 180,000 - 260,000; Full time

Job summary

HeartCentrix Solutions seeks a seasoned Architect to define and drive the technical architecture for an enterprise-scale agentic AI platform. This hands-on role requires real-world AI/LLM production experience and collaboration with ML and software engineers to ensure scalable, secure, and reliable systems.

You will define API contracts, data flows, and standards across the platform, mentor engineers, and stay current with emerging AI tech to guide platform evolution.

Qualifications

• 10+ years of software architecture/engineering experience.
• Hands-on experience with LLM orchestration frameworks such as LangChain, LangGraph, Semantic Kernel, or similar.
• Production experience building and deploying agentic AI or LLM-powered applications at scale.
• Strong distributed systems and microservices architecture experience.
• Strong API design experience, including REST and/or gRPC.
• Experience with at least one additional language such as Java, Go, or TypeScript.
• Strong understanding of event‑driven architecture and distributed systems.
• Experience with prompt engineering, tool‑use patterns, RAG pipelines, and AI agent reliability/observability.

Responsibilities

• Define and evolve the architecture for multi-agent systems, LLM orchestration, and AI platform services.
• Design frameworks and patterns for agent orchestration, tool use, LLM integration, and workflow execution.
• Establish best practices around reliability, observability, security, guardrails, and scalability for production AI systems.
• Lead technical design reviews and document key architecture decisions through ADRs.
• Define API contracts, data flows, integration patterns, and technical standards across the AI platform.
• Work closely with ML and software engineers to ensure scalable, secure, maintainable, production-ready solutions.
• Evaluate emerging agentic AI frameworks such as LangGraph, CrewAI, Semantic Kernel, AutoGen, and similar technologies.
• Design and review solutions involving LLM routing, prompt engineering, RAG, tool use, and multi-agent workflows.
• Help establish standards for monitoring, evaluation, and reliability of AI agents.
• Mentor engineers and provide guidance on building production‑grade AI applications.
• Stay current on emerging AI technologies and determine which ones are worth bringing into the platform.
• Be hands‑on when needed, including prototyping and validating architectural approaches through code.

Skills

LLM orchestration

Distributed systems

API design

REST/gRPC

Programming languages

Event-driven architecture

Prompt engineering

Tools

LangChain

LangGraph

Semantic Kernel

AutoGen

Job description

HeartCentrix Solutions seeks a seasoned Architect to define and drive the technical architecture for an enterprise-scale agentic AI platform. This hands-on role requires real-world AI/LLM production experience and collaboration with ML and software engineers to ensure scalable, secure, and reliable systems.

You will define API contracts, data flows, and standards across the platform, mentor engineers, and stay current with emerging AI tech to guide platform evolution.