Senior Data Engineer: Databricks & AI-Driven Platforms

EPAM Systems; United States; Remote; USD 140,000 - 200,000; Full time

Benefits offered by this job

Healthcare benefits

Paid time off and sick leave

Upskilling, reskilling and certif...

Job summary

EPAM Systems, Inc. is seeking a Lead Data Engineer to build a next-generation analytics platform with a strong focus on Databricks and scalable data products.

You will blend hands-on delivery with technical leadership across ingestion, modeling, governance, and AI-enabled engineering practices. You will design scalable data frameworks, implement batch and streaming pipelines, and deliver trusted datasets and governed layers for reporting.

Qualifications

• 5+ years of data engineering experience.
• 1+ years of technical leadership guiding engineering standards.
• Experience delivering end-to-end analytics solutions.
• Advanced Spark and PySpark expertise.
• Databricks production experience and optimization.
• Strong SQL for data transformation and analytics.
• Knowledge of data governance, security, and lineage.
• CI/CD and Data Engineering SDLC practices.
• English proficiency at least B2 for collaboration.

Responsibilities

• Design scalable data ingestion, transformation, and data product frameworks.
• Build batch, near real-time, and streaming pipelines on Databricks.
• Deliver end-to-end data products for analytics across domains.
• Develop trusted datasets, semantic models, and governed layers.
• Implement data quality, lineage, monitoring, and observability.
• Enable self-service analytics with reusable datasets and features.
• Lead POCs and evaluate new Databricks capabilities.
• Define AI SDLC patterns and mentor engineers.

Skills

Data engineering experience

Technical leadership

Communication

English (B2)

Education

Bachelor's degree in CS or related

Tools

Databricks

Apache Spark

PySpark

SQL

CI/CD

Data governance

Job description

EPAM Systems, Inc. is seeking a Lead Data Engineer to build a next-generation analytics platform with a strong focus on Databricks and scalable data products.

You will blend hands-on delivery with technical leadership across ingestion, modeling, governance, and AI-enabled engineering practices. You will design scalable data frameworks, implement batch and streaming pipelines, and deliver trusted datasets and governed layers for reporting.