Remote Python AI Infrastructure Engineer

EPAM Systems Inc; San Jose (CA); Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance (

Health Savings Account

Flexible Spending Accounts (Healthcare

Short-Term and Long-Term Disability

Life and AD&D Insurance

Employee Assistance Program

LinkedIn learning solutions

Matched 401(k) Retirement Savings Plan

Paid Time Off – 15-25 days

Job summary

EPAM Systems, Inc. is hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it grows from a Confluence-focused RAG chatbot to a broader, agentic knowledge system.

The role emphasizes scalable backend services, robust retrieval pipelines, and production-grade AI tooling. The position is remote within the United States (excluding New York City) with a salary range of $130,000 to $145,000 per year.

Qualifications

• Strong, hands-on Python experience in platform or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.
• Systems understanding: embedding pipelines, vector search, and LLM-backed systems.
• Strong skills across metrics, tracing, dashboards, alerting, and log analysis.
• Experience with ingestion, ETL, or content-processing pipelines at scale.
• Innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python

CLI tools

LLM infrastructure

Distributed systems

Observability

Python tooling

Tools

LangGraph

LangChain

pgvector

OpenTelemetry

Prometheus Grafana

Docker

Helm

Kubernetes

GitHub Actions

Job description

EPAM Systems, Inc. is hiring a Python AI Engineer to operate and evolve the infrastructure behind an enterprise knowledge base platform as it grows from a Confluence-focused RAG chatbot to a broader, agentic knowledge system.

The role emphasizes scalable backend services, robust retrieval pipelines, and production-grade AI tooling. The position is remote within the United States (excluding New York City) with a salary range of $130,000 to $145,000 per year.