Lead ML/AI Solution Engineer with Databricks

EPAM Systems Inc

Turkey

On-site

TRY 6,054,000 - 9,082,000

Full time

10 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Continuous upskilling
Mentoring programs
Certification and development support
Access to 2,500+ internal courses
English language courses
Extra leave days
Referral bonuses
USD salary compensation
Private health insurance
IT equipment provided

Job summary

EPAM Systems Inc. seeks a seasoned Lead ML/AI Solution Engineer to architect and launch a personalization platform with scalable API access, leveraging Python FastAPI and AWS infrastructure.

You will team with Data Scientists to productionize models, ensure reliability, and monitor performance across Databricks Model Serving endpoints. Responsibilities include deploying models, building a robust API service, implementing caching and timeouts, securing service authentication, and driving infra

Qualifications

  • 5+ years of experience in ML/AI engineering, building and serving recommendation or ranking models.
  • At least 1 year of relevant leadership experience.
  • Hands-on knowledge of Collaborative Filtering, Two-Tower Architectures, and Learning-to-Rank approaches.
  • Strong proficiency in Python with production experience building services using FastAPI.
  • Understanding of asynchronous processing, connection pooling, and caching strategies.
  • Expertise in timeout handling, fail-open mechanisms, and resilient service design.
  • Background in registering, versioning, and serving ML models with MLflow and Databricks Model Serving.
  • Familiarity with Service Principal authentication, endpoint scaling, and version management.
  • Competency in monitoring latency, errors, and fallback rates, including creating alerts and dashboards.
  • Skills in load-testing tools such as k6 or Locust, with the capability to validate p99 latency targets.
  • Capability to explain technical concepts and outcomes in business terms, working with engineering, data science, and business stakeholders.
  • English proficiency at an Upper-Intermediate level (B2) or higher.

Responsibilities

  • Lead ML/AI engineering projects and operationalize personalization models with Data Scientists.
  • Develop a FastAPI service calling model serving endpoints and ensure reliability.
  • Implement production-grade caching, timeouts, and fail-open strategies.
  • Set up secure cross-service authentication and Databricks integration.
  • Define infra with Terraform and plan a simple CI/CD pipeline.
  • Observe, alert, and monitor latency, errors, and fallbacks.
  • Conduct load and performance testing; validate under expected traffic.
  • Define REST API contracts and perform contract testing with consuming teams.
  • Explain technical results and business impact to stakeholders.

Skills

ML/AI engineering
Leadership
Collaborative Filtering
Two-Tower architectures
Learning-to-Rank
Python (FastAPI)
Async processing / caching
Resilient service design
MLflow / Databricks
Service Principal authentication
Observability / monitoring
Load testing (k6/Locust)
Communication to stakeholders
English (B2+)

Tools

FastAPI
MLflow
Databricks Model Serving
Terraform
AWS API Gateway
AWS Lambda
OpenAPI

Job description

We are seeking a seasoned Lead ML/AI Solution Engineer to architect, develop, and launch a personalization platform that delivers recommendation and ranking models via a scalable API layer. The system comprises a Python FastAPI service exposed through AWS API Gateway and Lambda, integrating with Databricks Model Serving endpoints.

The engineer will partner closely with Data Scientists to operationalize personalization models, guarantee production‑grade reliability, and confirm performance through testing and monitoring.

Responsibilities
  • Partner with Data Scientists to adapt, package, and deploy personalization models (recommendation and ranking models) to Databricks Model Serving using MLflow
  • Develop and maintain a FastAPI service that invokes one or more model serving endpoints
  • Apply production‑grade engineering practices, including caching, connection pooling, request timeouts, and fail‑open fallback mechanisms
  • Set up secure authentication between services and Databricks using Service Principals
  • Establish and maintain the AWS integration layer, including API Gateway, AWS Lambda, and networking/egress connectivity
  • Define and govern infrastructure using Terraform and build a simple CI/CD pipeline
  • Enable observability and monitoring, including latency, error, and fallback metrics
  • Run load and performance testing to validate system behavior under expected traffic volumes
  • Specify REST API contracts and implement contract testing to enable early integration by consuming teams
  • Carry out offline evaluation of personalization models and support online validation through A/B testing or shadow testing where feasible
  • Present technical results and business impact to both technical and non‑technical stakeholders
Requirements
  • 5+ years of experience in ML/AI engineering, building and serving recommendation or ranking models, including offline model evaluation
  • At least 1 year of relevant leadership experience
  • Hands‑on knowledge of Collaborative Filtering, Two‑Tower Architectures, and Learning‑to‑Rank approaches
  • Strong proficiency in Python with production experience building services using FastAPI
  • Understanding of asynchronous processing, connection pooling, and caching strategies
  • Expertise in timeout handling, fail‑open mechanisms, and resilient service design
  • Background in registering, versioning, and serving ML models with MLflow and Databricks Model Serving
  • Familiarity with Service Principal authentication, endpoint scaling, and version management
  • Competency in monitoring latency, errors, and fallback rates, including creating alerts and dashboards
  • Skills in load‑testing tools such as k6 or Locust, with the capability to validate p99 latency targets
  • Capability to explain technical concepts and outcomes in business terms, working with engineering, data science, and business stakeholders
  • English proficiency at an Upper‑Intermediate level (B2) or higher
Nice to have
  • Proficiency in Infrastructure‑as‑Code with Terraform and CI/CD pipeline implementation adequate to deploy and hand over a reproducible POC environment
  • Familiarity with AWS API Gateway and Lambda integration, including awareness of cold starts and performance optimization
  • Knowledge of VPC networking and egress connectivity to Databricks
  • Expertise in OpenAPI‑first REST API design and contract testing with Pact or schema‑based testing approaches
  • Capability to architect services for multi‑region deployment and future scalability
  • Understanding of GenAI for personalization, including embeddings, vector search, LLM‑based re‑ranking, and personalized explanations powered by GenAI
We offer
  • CONTINUOUS UPSKILLING, LEARNING & DEVELOPMENT
    • Diversity of tasks and projects
    • Assessment center for objective review of competency level
    • Personal development plan
    • Mentoring programs and leadership development
    • Certification and professional development support
    • Access to learning platforms including more than 2,500 internal courses
    • English courses taught by certified teachers
  • CORPORATE BENEFITS
    • Extra leave days
    • Referral bonuses
  • COMPENSATION PACKAGE
    • Competitive compensation paid in USD
    • Regular salary and performance reviews
  • MEDICAL & HEALTHCARE
    • Private health insurance
    • Well‑being events
  • WORKING ENVIRONMENT
    • Recreation areas and kitchens
    • Tea, coffee and snacks
    • Sports equipment and game consoles
    • IT Equipment
    • Microsoft’s Software Assurance Home Use Program (HUP)

Please note that our Talent Attraction Team reviews applications and CVs submitted in English.

EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI‑Native enterprises, driving measurable value from innovation and digital investments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Software Engineer/ AWS, Databricks, PySpark
Senior Data Software Engineer/ AWS, Databricks, PySpark

EPAM Systems Inc • Turkey

On-site
TRY 6,417,000 - 8,391,000
Upskilling programs
Private health insurance
Referral bonuses
+2
Senior Data DevOps Engineer
Senior Data DevOps Engineer

EPAM Systems Inc • Turkey

On-site
TRY 5,926,000 - 8,889,000
Senior Generative AI Operations (GenAI Ops) Engineer
Senior Generative AI Operations (GenAI Ops) Engineer

EPAM Systems Inc • Turkey

On-site
TRY 2,917,000 - 4,375,000
Private health insurance
English courses
Continuous upskilling
Data DevOps Lead
Data DevOps Lead

EPAM Systems Inc • Turkey

On-site
TRY 4,442,000 - 6,417,000
Private health insurance
English courses
Mentoring programs
+2
Lead Data Integration Engineer
Lead Data Integration Engineer

EPAM Systems Inc • Turkey

On-site
TRY 5,923,000 - 8,885,000
Learning platforms access
English courses taught by certified老师
Private health insurance
+2
Data Architect
Data Architect

EPAM Systems Inc • Turkey

On-site
TRY 4,444,000 - 7,407,000
Continuous upskilling
Private health insurance
USD salary
Senior Data Integration Engineer
Senior Data Integration Engineer

EPAM Systems Inc • Turkey

On-site
TRY 5,923,000 - 8,885,000
Continuous upskilling
Private health insurance
Professional development support
+2
AI Native Solution Architect
AI Native Solution Architect

EPAM Systems Inc • Turkey

On-site
TRY 6,054,000 - 9,082,000
Upskilling program
Corporate benefits
USD compensation
+2
Lead Data Software Engineer
Lead Data Software Engineer

EPAM Systems Inc • Turkey

On-site
TRY 5,941,000 - 7,921,000
Continuous upskilling
Internal courses
Mentoring programs
+5
Generative AI Operations Engineer (GenAI Ops)
Generative AI Operations Engineer (GenAI Ops)

EPAM Systems Inc • Turkey

On-site
TRY 300,000 - 460,000
Private health insurance
English courses
Professional development support
+2