Principal AI Solution Engineer

EPAM Systems Inc

Georgia

Remote

USD 190,000 - 270,000

Full time

23 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Remote work in Georgia
AI Certifications
Stock Purchase Plan
Medical & family care
Relocation opportunities

Job summary

EPAM Systems Inc. is seeking a Principal AI Solution Engineer to help design a sovereign, multi-tenant AI platform with applied products in Arabic and English. You will influence architecture across applied AI, AI infrastructure, and backend platform.

The role offers remote work from anywhere in Georgia, with options to work from modern offices or coworking spaces. You will lead scalable systems and collaborate with senior engineers to deliver high-impact AI solutions.

Qualifications

  • 5+ years of hands-on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms.
  • At least 1 year of relevant leadership experience.
  • Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio.
  • Proficiency in production RAG end-to-end: ingestion, vector search, reranking and grounding evaluation.
  • Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework.
  • Competency in distributed systems, including idempotency, back-pressure and retry semantics, with strong event-driven architecture skills.
  • Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM.
  • Familiarity with Kubernetes on Azure.
  • Skills in at least one infrastructure language: Go, Rust, Java or Kotlin.
  • Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration.
  • Excellent command of written and spoken English (B2+ level).

Responsibilities

  • Set architecture for systems that span squads; write the decision down and defend it
  • Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
  • Own the reference RAG and agent architecture other teams build against
  • Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them
  • Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind

Skills

Python
FastAPI
Pydantic
asyncio
Distributed systems
PostgreSQL
GPU inference
Kubernetes
Go
Rust
Java
Kotlin
LangGraph
LangChain
OpenAI Agent SDK
Microsoft Agent Framework

Tools

vLLM
TGI
TensorRT-LLM

Job description

We are seeking a Principal AI Solution Engineer to join an engineering organization building a sovereign, multi-tenant agentic AI platform, along with the applied products on top of it. Everything ships under strict data residency constraints and operates in both Arabic and English. Squads are small — three senior engineers — and decisions are made in the room. You will work across three layers and need to be credible in all of them: applied AI, AI infrastructure, and the backend platform.

Experience the freedom of remote work from anywhere in Georgia, whether from the comfort of your home, our modern offices in Tbilisi and Batumi or a coworking space in Kutaisi.

Responsibilities
  • Set architecture for systems that span squads; write the decision down and defend it
  • Build and tune GPU-based serving — vLLM, TGI or TensorRT-LLM — for latency, throughput and a cost per token you can justify
  • Own the reference RAG and agent architecture other teams build against
  • Define service boundaries, API contracts, event-driven infrastructure and the SLO work that prevents incidents rather than answering them
  • Develop offline and online evaluation and regression detection, so models, prompts and retrieval can change without flying blind
Requirements
  • 5+ years of hands‑on engineering experience with shipped production systems spanning applied AI, AI infrastructure and backend platforms
  • At least 1 year of relevant leadership experience
  • Expertise in Python and its production ecosystem, including FastAPI, Pydantic and asyncio
  • Proficiency in production RAG end‑to‑end: ingestion, vector search, reranking and grounding evaluation
  • Background in agent orchestration frameworks such as LangGraph, LangChain, OpenAI Agent SDK or Microsoft Agent Framework
  • Competency in distributed systems, including idempotency, back‑pressure and retry semantics, with strong event‑driven architecture skills
  • Knowledge of PostgreSQL at scale, along with GPU inference and serving using vLLM, TGI or TensorRT-LLM
  • Familiarity with Kubernetes on Azure
  • Skills in at least one infrastructure language: Go, Rust, Java or Kotlin
  • Capability to use agentic coding tooling as a daily workflow, including project setup with CLAUDE.md, skills and agent configuration
  • Excellent command of written and spoken English (B2+ level)
Nice to have
  • Showcase of pgvector or Qdrant at production scale
  • Experience with Arabic-language, voice or conversational AI
  • Background in AI or mission‑critical delivery in regulated environments such as government, defence or financial services
  • Familiarity with Azure sovereign cloud, Entra ID and Azure OpenAI
  • Understanding of Langfuse, Grafana, Prometheus and Terraform
We offer
  • We connect like-minded people
    • Delivering innovative solutions to industry leaders, making a global impact
    • Enjoyable working environment, whether it is the vibrant office or the comfort of your own home
    • Opportunity to work abroad for up to two months per year
    • Relocation opportunities within our offices in 55+ countries
    • Corporate and social events
  • We invest in your growth
    • AI Certifications from our strategic partners: Anthropic, Google, Microsoft and OpenAI
    • Cloud Certifications: GCP, Azure and AWS
    • Leadership development, career advising, soft skills and well‑being programs
    • Unlimited access to EPAM's internal learning database
    • Free English classes with certified teachers
  • We cover it all
    • Participation in the Employee Stock Purchase Plan
    • Monetary bonuses for engaging in the referral program
    • Comprehensive medical & family care package
    • Five trust days per year (sick leave without a medical certificate)
    • Benefits package (sports activities, a variety of stores and services)

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI‑Native enterprises, driving measurable value from innovation and digital investments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal DevOps Engineer (Azure & .NET Ecosystem)
Principal DevOps Engineer (Azure & .NET Ecosystem)

EPAM Systems Inc • Georgia

Remote
USD 140,000 - 200,000
Relocation assistance
International work stint
Medical & family care package
+2
Solution Architect - AI SDLC with GitHub & Microsoft
Solution Architect - AI SDLC with GitHub & Microsoft

EPAM Systems Inc • Georgia

Remote
USD 150,000 - 210,000
Relocation opportunities
International travel
Unlimited learning resources
+2
Principal AI Solution Engineer
Principal AI Solution Engineer

EPAM Systems • United States

Remote
USD 180,000 - 240,000
Application Environment Acceleration Engineer
Application Environment Acceleration Engineer

EPAM Systems Inc • Georgia

Remote
USD 110,000 - 170,000
AI Certifications
Cloud Certifications: Azure
English classes
+2
Senior Azure DevOps Engineer
Senior Azure DevOps Engineer

EPAM Systems Inc • Georgia

Remote
USD 46,000 - 69,000
AI Certifications
Cloud Certifications
Leadership development
+2
Business Analytics Consultant
Business Analytics Consultant

EPAM Systems Inc • Georgia

Remote
USD 120,000 - 180,000
Relocation opportunities in 55+ countr
Corporate and social events
AI Certifications from partners
+2
Senior AI Engineer
Senior AI Engineer

EPAM Systems Inc • Newtown (PA)

On-site
MXN 1,200,000 - 2,000,000
Healthcare benefits
Employee financial programs
Paid time off and sick leave
+6
Senior Microsoft 365 Engineer
Senior Microsoft 365 Engineer

EPAM Systems Inc • Georgia

Remote
USD 120,000 - 170,000
Relocation opportunities in 55+ countr
Senior AI Software Engineer (Python)
Senior AI Software Engineer (Python)

EPAM Systems • United States

Remote
USD 140,000 - 210,000
Vacation leave
Sick leave
Medical insurance
+6
Python AI Engineer
Python AI Engineer

EPAM Systems Inc • Newtown (PA)

Remote
USD 130,000 - 145,000
Medical, Dental and Vision Insurance
Health Savings Account
Flexible Spending Accounts
+8