Python AI Engineer — Production-Grade Infra

EPAM Systems Inc; McLean (VA); Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

Health Savings Account

401(k) Matching

Paid Time Off

LinkedIn Learning access

Discretionary bonus program

Job summary

EPAM Systems, Inc. is hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform. You will architect robust backend services with Python 3.11, FastAPI, and async SQL tooling, while shaping retrieval pipelines and agent runtime capabilities.

Join a team expanding toward hybrid retrieval, multi-source ingestion, and shared chat primitives. This role emphasizes reliability, observability, and cost-efficient AI workloads in a remote environment.

Qualifications

• Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python

CLI tools

Golang

Rust

LangGraph

LangChain

pgvector

Retrieval pipelines

Docker

Kubernetes

Observability

OpenTelemetry

FastAPI

Tools

pgvector

FastAPI

SQLAlchemy

asyncpg

Pydantic

GitHub Actions

Kubernetes

Helm

Grafana

Redis

Job description

EPAM Systems, Inc. is hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform. You will architect robust backend services with Python 3.11, FastAPI, and async SQL tooling, while shaping retrieval pipelines and agent runtime capabilities.

Join a team expanding toward hybrid retrieval, multi-source ingestion, and shared chat primitives. This role emphasizes reliability, observability, and cost-efficient AI workloads in a remote environment.