Python AI Infrastructure Engineer

EPAM Systems Inc; United States; Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

Matched 401(k) Retirement Savings Plan

Paid Time Off

Job summary

EPAM Systems Inc is hiring a Python AI Engineer to advance an enterprise knowledge platform, expanding from Confluence-like ingestion to a hybrid retrieval stack and agent runtime.

You will design robust backend services in Python 3.11 with FastAPI, Pydantic, async SQLAlchemy, and asyncpg, improve grounding, observability, and release workflows, while collaborating with product and engineering teams. This role offers a base salary range and remote options for the US.

Qualifications

• Hands-on Python in platform, automation, or infrastructure-heavy environments.
• Experience with CLI tools using Python, Go, or Rust.
• Experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Design evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Familiar with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python

FastAPI

Pydantic

SQLAlchemy

asyncpg

LangGraph

LangChain

pgvector

Retrieval pipelines

Docker

Kubernetes

GitHub Actions

OpenTelemetry

observability

Golang

Rust

Tools

Docker

Helm

GitHub Actions

Kubernetes

asyncpg

OpenTelemetry

pgvector

LangGraph

LangChain

Job description

EPAM Systems Inc is hiring a Python AI Engineer to advance an enterprise knowledge platform, expanding from Confluence-like ingestion to a hybrid retrieval stack and agent runtime.

You will design robust backend services in Python 3.11 with FastAPI, Pydantic, async SQLAlchemy, and asyncpg, improve grounding, observability, and release workflows, while collaborating with product and engineering teams. This role offers a base salary range and remote options for the US.