Lead ML/AI Engineer for Personalization & Databricks

EPAM Systems

United States

Remote

USD 180,000 - 240,000

Full time

9 days ago

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

EPAM Systems Inc. seeks a seasoned Lead ML/AI Solution Engineer to architect and launch a personalized recommendation platform. You will work with Data Scientists to operationalize models via a scalable FastAPI API, backed by Databricks Model Serving, and managed on AWS with Terraform-driven infra.

You will lead production-grade engineering, implement caching and observability, and ensure multi-region readiness with OpenAPI-first design and contract testing.

Qualifications

  • 5+ years of ML/AI engineering experience, building and serving recommendation or ranking models.

Responsibilities

  • Partner with Data Scientists to adapt, package, and deploy personalization models to Databricks Model Serving.
  • Develop and maintain a FastAPI service that invokes model serving endpoints.
  • Apply production-grade engineering practices including caching, connection pooling, timeouts, and fail-open fallbacks.
  • Set up secure authentication between services and Databricks using Service Principals.
  • Establish and maintain the AWS integration layer with API Gateway and Lambda.
  • Define infrastructure with Terraform and build a CI/CD pipeline.
  • Enable observability and monitoring, including latency, error, and fallback metrics.
  • Run load and performance testing to validate system behavior under traffic.
  • Specify REST API contracts and perform contract testing (Pact).
  • Carry out offline evaluation and online validation via A/B/shadow testing where feasible.
  • Present technical results and business impact to stakeholders.

Skills

Python
FastAPI
MLflow
Databricks
OpenAPI
Contract testing
Observability
Load testing
AWS
Service Principals

Tools

Terraform
AWS API Gateway
AWS Lambda
K6/Locust
Pact
Databricks Model Serving
MLflow

Job description

EPAM Systems Inc. seeks a seasoned Lead ML/AI Solution Engineer to architect and launch a personalized recommendation platform. You will work with Data Scientists to operationalize models via a scalable FastAPI API, backed by Databricks Model Serving, and managed on AWS with Terraform-driven infra.

You will lead production-grade engineering, implement caching and observability, and ensure multi-region readiness with OpenAPI-first design and contract testing.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead ML/AI Solution Engineer with Databricks
Lead ML/AI Solution Engineer with Databricks

EPAM Systems • United States

Remote
USD 180,000 - 240,000
Lead ML/AI Solution Engineer with Databricks
Lead ML/AI Solution Engineer with Databricks

EPAM Systems Inc • Newtown (PA)

On-site
USD 140,000 - 190,000
Career development
Private health insurance
Referral bonuses
+1
ML Engineer & Platform Engineer – Personalization at Scale
ML Engineer & Platform Engineer – Personalization at Scale

Tap Growth ai • Dallas (TX)

Remote
USD 140,000 - 190,000
Lead ML Engineer: Real-Time Personalization & AI Pipelines
Lead ML Engineer: Real-Time Personalization & AI Pipelines

JP Morgan Chase • New York (NY)

On-site
USD 180,000 - 260,000
Health care coverage
On-site health centers
Retirement savings plan
+2
Staff ML Engineer - Personalization & Production AI
Staff ML Engineer - Personalization & Production AI

Databricks Inc. • New York (NY)

On-site
USD 190,000 - 253,000
Senior Software Architect - AI Personalization & ML
Senior Software Architect - AI Personalization & ML

PayPal, Inc. • New York (NY)

On-site
USD 180,000 - 240,000
Paid Time Off
Healthcare Coverage
Financial Wellness Resources
+3
Senior AI Engineer: GenAI, ML & Diagnostics on Databricks
Senior AI Engineer: GenAI, ML & Diagnostics on Databricks

EPAM Systems • United States

Remote
USD 120,000 - 190,000
Senior ML Engineer - Production-Scale Personalization
Senior ML Engineer - Production-Scale Personalization

Iterable, Inc. • Atlanta (GA)

On-site
USD 150,000 - 250,000
Senior AI/ML Lead Engineer - Databricks & Azure ML
Senior AI/ML Lead Engineer - Databricks & Azure ML

Tech Junction Ltd • Dallas (TX)

On-site
USD 180,000 - 240,000
ML Engineer / ML Platform Engineer
ML Engineer / ML Platform Engineer

Tap Growth ai • Dallas (TX)

Remote
USD 140,000 - 190,000