Lead AI Solution Engineer with Databricks, ML

EPAM Systems; Turkey; On-site; TRY 7,493,000 - 9,491,000; Full time

Benefits offered by this job

Extra leave days

Referral bonuses

Private health insurance

Well-being events

IT Equipment

Job summary

EPAM Systems Inc is seeking a Lead AI Solution Engineer to architect, launch, and manage production-grade ML systems. You will work hands-on as a Data/ML Engineer, delivering real-time and batch ML solutions and building streaming pipelines with Spark Streaming.

The role focuses on scalable feature engineering, model training and inference pipelines, and ensuring reliability and low-latency performance in production.

Qualifications

• 7+ years of experience building, deploying, and operating offline and online feature engineering pipelines.
• Proficiency in Databricks, Spark/PySpark, Python, and SQL.
• Expertise in model training and real-time inferencing pipelines.
• Experience processing large-scale unstructured data.
• Knowledge of Spark Streaming.
• Experience with real-time feature generation and low-latency model inference.
• Proven track record of running production-grade ML systems.
• English proficiency at B2 level or higher.
• Nice to have exposure to MLflow and established MLOps workflows; hands-on AWS background; prior work in Customer Analytics, Recommendation Systems, or Retail industries.

Responsibilities

• Design and optimize feature engineering pipelines for both batch and real-time workloads.
• Build, deploy, and maintain scalable model training and inference pipelines.
• Process structured and unstructured data at scale.
• Develop streaming solutions using Spark Streaming.
• Enable real-time feature generation and model serving.
• Ensure reliability, scalability, and performance of ML solutions in production.
• Support batch pipelines for model training and retraining.
• Operate and maintain production ML systems to ensure consistent performance.

Skills

Databricks

Spark/PySpark

Python

SQL

Real-time inference

Feature engineering

MLOps

MLflow

Tools

Spark Streaming

AWS

Job description

We are looking for a Lead AI Solution Engineer who brings strong expertise in Databricks and Machine Learning to architect, launch, and manage production-level ML systems. The ideal candidate works hands-on as a Data Engineer or Machine Learning Engineer, has demonstrated success delivering both real-time and batch ML solutions, possesses solid skills in building streaming pipelines, and brings experience maintaining the scalability and reliability of ML systems once they are live in production.ResponsibilitiesDesign and optimize feature engineering pipelines for both batch and real-time workloadsBuild, deploy, and maintain scalable model training and inference pipelinesProcess structured and unstructured data at scaleDevelop streaming solutions using Spark StreamingEnable real-time feature generation and model servingEnsure reliability, scalability, and performance of ML solutions in productionSupport batch pipelines for model training and retrainingOperate and maintain production ML systems to ensure consistent performanceRequirements7+ years of experience building, deploying, and operating offline and online feature engineering pipelinesProficiency in Databricks, Spark/PySpark, Python, and SQLExpertise in model training and real-time inferencing pipelinesExperience processing large-scale unstructured dataKnowledge of Spark StreamingExperience with real-time feature generation and low-latency model inferenceProven track record of running production-grade ML systemsEnglish proficiency at B2 level or higherNice to haveExposure to MLflow and established MLOps workflowsHands-on background with AWSPrior work in Customer Analytics, Recommendation Systems, or Retail industriesWe offerCONTINUOUS UPSKILLING, LEARNING & DEVELOPMENTDiversity of tasks and projectsAssessment center for objective review of competency levelPersonal development planMentoring programs and leadership developmentCertification and professional development supportAccess to learning platforms including more than 2,500 internal coursesEnglish courses taught by certified teachersCORPORATE BENEFITSExtra leave daysReferral bonusesCOMPENSATION PACKAGECompetitive compensation paid in USDRegular salary and performance reviewsMEDICAL & HEALTHCAREPrivate health insuranceWell-being eventsWORKING ENVIRONMENTRecreation areas and kitchensTea, coffee and snacksSports equipment and game consolesIT EquipmentMicrosoft’s Software Assurance Home Use Program (HUP)Please note that our Talent Attraction Team reviews applications and CVs submitted in English.EPAM is global leader in AI transformation engineering and integrated consulting, serving Forbes Global 2000 companies and ambitious startups. With over thirty years of expertise in custom software, product and platform engineering, we empower our clients to become AI-Native enterprises, driving measurable value from innovation and digital investments.