Databricks & Spark Lead Data Engineer for Analytics

EPAM Systems Inc; United States; Remote; USD 140,000 - 190,000; Full time

Job summary

EPAM Systems seeks a Lead Data Engineer to shape scalable ingestion, transformation, and governed data products on Databricks. You will blend hands-on delivery with technical leadership to enable self-service analytics and AI-assisted engineering.

You will design and implement data pipelines using Spark/PySpark, enforce medallion architectural best practices, and mentor engineers across teams while delivering end-to-end data solutions.

Qualifications

• Proven track record as a data engineering leader.
• Experience delivering end-to-end data solutions.
• Strong capability to mentor engineers and drive standards.
• Experience with data governance, quality, and observability.

Responsibilities

• Design scalable data ingestion and transformation frameworks on Databricks.
• Define and enforce Databricks best practices for medallion layers and ops excellence.
• Build batch and streaming pipelines using Spark and PySpark.
• Deliver end-to-end data products from ingestion through governed layers.
• Develop trusted datasets and semantic models for reporting and self-service analytics.

Skills

Data engineering leadership

Mentoring engineers

End-to-end delivery

Data governance & quality

Tools

Databricks

Apache Spark

PySpark

SQL

Job description

EPAM Systems seeks a Lead Data Engineer to shape scalable ingestion, transformation, and governed data products on Databricks. You will blend hands-on delivery with technical leadership to enable self-service analytics and AI-assisted engineering.

You will design and implement data pipelines using Spark/PySpark, enforce medallion architectural best practices, and mentor engineers across teams while delivering end-to-end data solutions.