Remote Python AI Platform Engineer

EPAM Systems Inc; Austin (TX); Remote; USD 130,000 - 145,000; Full time

Benefits offered by this job

Medical, Dental and Vision Insurance

Health Savings Account

Flexible Spending Accounts

Disability Insurance

Life and AD&D Insurance

Employee Assistance Program

LinkedIn learning solutions

401(k) Matching

Paid Time Off 15-25 days

Paid Holidays

Legal Plan and Identity Theft Protec

Accident Insurance

Employee Discounts

Pet Insurance

Employee Stock Purchase Program

Discretionary annual bonus

Discretionary Long-Term Incentive (LTI

Job summary

EPAM Systems, Inc. is seeking a Python AI Engineer to evolve our enterprise knowledge platform infrastructure. You will work on Confluence/GitHub ingestion pipelines, vector searches, and RAG-enabled services using Python and FastAPI.

You will design robust retrieval, grounding, and evaluation pipelines, build agent runtimes, and enhance observability with OpenTelemetry, Prometheus, and Grafana. Collaboration across product and engineering teams will be essential.

Qualifications

• Strong, hands-on Python experience in platform, automation, or infrastructure-heavy environments.
• Experience building CLI tools using Python, Golang, or Rust.
• Hands-on experience with LangGraph, LangChain, pgvector, and modern retrieval pipelines.
• Experience designing evaluation frameworks for LLM-backed systems, including regression detection and quality measurement.
• Strong experience with Docker, Helm, GitHub Actions, and Kubernetes-oriented workflows.
• Systems Understanding: Familiarity with the operational characteristics of embedding pipelines, vector search, and LLM-backed systems.
• Strong skills across metrics, tracing, dashboards, alerting, and log analysis.
• Experience with ingestion, ETL, or content-processing pipelines at scale.
• An innate ability to think in terms of reliability, cost, latency, throughput, and disaster recovery.

Responsibilities

• Architect and implement robust backend services using Python 3.11, FastAPI, Pydantic, SQLAlchemy async, and asyncpg.
• Design trade-offs around retrieval quality, latency, cost, safety, and operational simplicity.
• Build production-grade agent runtime capabilities, including memory boundaries, tool sandboxing, permissions, and budget controls.
• Improve answer grounding, failure analysis, and citation enforcement for enterprise-grade dependability.
• Create comprehensive observability and operational feedback loops using OpenTelemetry, Prometheus/Grafana, Docker/Helm, and GitHub Actions.
• Ingestion infrastructure across current and future content sources.
• Full-stack observability across application, pipeline, database, and model-serving behavior.
• Cost, latency, throughput, and failure-mode management for AI-heavy workloads.
• Release workflows that validate AI behavior changes, not just code compilation.
• Partner closely with product and engineering teams to support multiple conversational surfaces through a unified knowledge platform.

Skills

Python experience

CLI tools Python/Golang/Rust

LangGraph LangChain pgvector

LLM evaluation frameworks

Docker Helm GitHub Actions Kubernetes

Embeddings and vector search

Metrics, tracing, dashboards

ETL pipelines

Reliability, cost, latency

Tools

Docker

Helm

GitHub Actions

Kubernetes

LangGraph

LangChain

pgvector

Job description

EPAM Systems, Inc. is seeking a Python AI Engineer to evolve our enterprise knowledge platform infrastructure. You will work on Confluence/GitHub ingestion pipelines, vector searches, and RAG-enabled services using Python and FastAPI.

You will design robust retrieval, grounding, and evaluation pipelines, build agent runtimes, and enhance observability with OpenTelemetry, Prometheus, and Grafana. Collaboration across product and engineering teams will be essential.