Python AI Infrastructure Engineer — Remote

EPAM Systems Inc; Seattle (WA); Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

401(k) Plan with company match

Paid Time Off

Job summary

EPAM Systems, Inc. is seeking a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it expands beyond Confluence-focused workflows.

You will design and build backend services in Python 3.11 with FastAPI, Pydantic, SQLAlchemy async, and asyncpg, ensuring scalable, observable AI infrastructure for multi-source ingestion and retrieval. Join a team that balances performance, reliability, and cost, implements robust evaluation pipelines, and

Qualifications

• Strong hands-on Python experience in platform, automation, or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.
• Systems understanding of embedding pipelines, vector search, and LLM-backed systems.
• Strong skills across metrics, tracing, dashboards, alerting, and log analysis.
• Experience with ingestion, ETL, or content-processing pipelines at scale.
• Innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python

CLI tools

retrieval pipelines

Systems reliability

Metrics & tracing

Cost & latency awareness

LLM-backed systems

Distributed systems

Observability

Tools

LangGraph

LangChain

pgvector

OpenTelemetry

Prometheus

Grafana

Docker

Helm

GitHub Actions

Kubernetes

Job description

EPAM Systems, Inc. is seeking a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it expands beyond Confluence-focused workflows.

You will design and build backend services in Python 3.11 with FastAPI, Pydantic, SQLAlchemy async, and asyncpg, ensuring scalable, observable AI infrastructure for multi-source ingestion and retrieval. Join a team that balances performance, reliability, and cost, implements robust evaluation pipelines, and