Remote Python AI Engineer: Scalable AI Infra & RAG

EPAM Systems Inc; Atlanta (GA); Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

401(k) Retirement Savings

Paid Time Off

Holidays

Life Insurance

Employee Discounts

Employee Stock Purchase Program

Job summary

EPAM Systems, Inc. is hiring a Python AI Engineer to scale the backend of an enterprise knowledge base, evolving from Confluence-based ingestion to a broader, agentic knowledge system.

You’ll design and build scalable Python services, retrieval pipelines, and agent infrastructure. You will work on hybrid retrieval, multi-source ingestion, and robust evaluation while ensuring observability, reliability, and cost efficiency across deployments.

Qualifications

• Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.
• Systems Understanding: Familiarity with embedding pipelines, vector search, and LLM-backed systems.
• Strong skills across metrics, tracing, dashboards, alerting, and log analysis.
• Experience with ingestion, ETL, or content-processing pipelines at scale.
• An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python

CLI tools

LangGraph

LangChain

pgvector

Retrieval pipelines

Docker

Kubernetes

Observability

Metrics & dashboards

Tools

Python 3.11

FastAPI

Pydantic

SQLAlchemy async

asyncpg

Job description

EPAM Systems, Inc. is hiring a Python AI Engineer to scale the backend of an enterprise knowledge base, evolving from Confluence-based ingestion to a broader, agentic knowledge system.

You’ll design and build scalable Python services, retrieval pipelines, and agent infrastructure. You will work on hybrid retrieval, multi-source ingestion, and robust evaluation while ensuring observability, reliability, and cost efficiency across deployments.