Python AI Engineer: Build Scalable AI Infra

EPAM Systems Inc; California; Hybrid; USD 93,000 - 107,000; Full time

Benefits offered by this job

Extended Health care

Dental and Vision

RRSP with Company match

Employee Stock Purchase Program

Telehealth

Life and AD&D Insurance

Employee Assistance Program

Job summary

EPAM Systems Inc is seeking a Python AI Engineer to build scalable AI infrastructure for an enterprise knowledge platform, evolving from Confluence-focused RAG to a broader agentic system. You will design and implement robust backend services with FastAPI, LangGraph, and modern retrieval pipelines, while ensuring observability and compliance across the stack.

The role focuses on production-grade agent runtime, grounding accuracy, and cost-conscious performance, with strong collaboration across

Qualifications

• Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python

LangGraph

LangChain

pgvector

Retrieval pipelines

Docker

Kubernetes

GitHub Actions

Observability

ETL

Tools

FastAPI

SQLAlchemy async

asyncpg

Job description

EPAM Systems Inc is seeking a Python AI Engineer to build scalable AI infrastructure for an enterprise knowledge platform, evolving from Confluence-focused RAG to a broader agentic system. You will design and implement robust backend services with FastAPI, LangGraph, and modern retrieval pipelines, while ensuring observability and compliance across the stack.

The role focuses on production-grade agent runtime, grounding accuracy, and cost-conscious performance, with strong collaboration across