Remote Python AI Platform Engineer

EPAM Systems Inc; Chicago (IL); Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical Insurance

Dental and Vision Insurance

401(k) Matching

Paid Time Off

Job summary

EPAM Systems, Inc. is seeking a Python AI Engineer to design and evolve the infrastructure behind an enterprise knowledge base platform as it expands from a Confluence-based RAG chatbot to a broader, agentic knowledge system.

You will build robust backend services using Python, FastAPI, and modern retrieval pipelines, while focusing on reliability, scalability, and production-grade safety across ingestion, evaluation, and observability, with a strong emphasis on tooling and performance.

Qualifications

• Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.
• Systems Understanding: Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems.
• Strong skills across metrics, tracing, dashboards, alerting, and log analysis.
• Experience with ingestion, ETL, or content-processing pipelines at scale.
• An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions
• Ingestion infrastructure across current and future content sources
• Full-stack observability across application, pipeline, database, and model-serving behavior
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads
• Release workflows that validate AI behavior changes, not just code compilation
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform

Skills

Python

Backend development

Automation / infra

Distributed systems

Observability

Tools

LangGraph

LangChain

pgvector

Docker

Helm

GitHub Actions

Kubernetes

OpenTelemetry

Grafana

Job description

EPAM Systems, Inc. is seeking a Python AI Engineer to design and evolve the infrastructure behind an enterprise knowledge base platform as it expands from a Confluence-based RAG chatbot to a broader, agentic knowledge system.

You will build robust backend services using Python, FastAPI, and modern retrieval pipelines, while focusing on reliability, scalability, and production-grade safety across ingestion, evaluation, and observability, with a strong emphasis on tooling and performance.