Senior AI Backend Architect

K Health; Illinois; On-site; USD 150,000 - 190,000; Full time

Job summary

K Health is hiring a Senior Backend Engineer to join our AI Engineering team in the United States. You will design and build scalable backend services and APIs powering intelligent systems, collaborating with data scientists, ML engineers, and product managers.

You will work with a hybrid model stack including OpenAI, Google Gemini, and self-hosted LLMs, and integrate with clinical systems (FHIR/EMR). A strong background in distributed systems and observability is essential.

Qualifications

• 6+ years of backend engineering experience with proficiency in multiple languages (Python/Java/Go/Rust/Kotlin).
• Solid understanding of AI systems architecture and LLM/inference pipelines.
• Proven experience building & scaling backend APIs, microservices, and background jobs.

Responsibilities

• Build and maintain reliable, scalable backend services for AI agent execution and orchestration.
• Develop AI agent systems for complex workflows using LangChain, LangGraph, LiteLLM, Langfuse.
• Orchestrate hybrid model stacks with OpenAI, Google Gemini, and self-hosted LLMs.
• Integrate with clinical systems (FHIR, EMR) and ensure observability with OpenTelemetry and Datadog.
• Design APIs (GraphQL, REST), workers, and event-driven systems interfacing with AI inference engines.
• Collaborate with Data Science, ML, and engineering teams to deploy AI features and improve backend performance.

Skills

Backend languages

AI systems

APIs

Databases

Distributed systems

Team collaboration

Tools

PostgreSQL

MySQL

MongoDB

Redis

RabbitMQ

Job description

K Health is hiring a Senior Backend Engineer to join our AI Engineering team in the United States. You will design and build scalable backend services and APIs powering intelligent systems, collaborating with data scientists, ML engineers, and product managers.

You will work with a hybrid model stack including OpenAI, Google Gemini, and self-hosted LLMs, and integrate with clinical systems (FHIR/EMR). A strong background in distributed systems and observability is essential.