Lead Data Engineer: Databricks & Data Platforms (Remote)

EPAM Systems; Georgia; On-site; USD 46,000 - 77,000; Full time

Benefits offered by this job

Work abroad

Relocation opportunities

Corporate events

Certifications (GCP, Azure, AWS)

Medical benefits

Stock Purchase Plan

Job summary

EPAM Systems is seeking a Lead Data Software Engineer with Databricks expertise to drive the design and evolution of end-to-end traceability solutions across the supply chain. You will provide technical leadership for heterogeneous data assets and data products, ensuring regulatory compliance and data-driven decision making.

The role involves collaborating with solution architects and platform teams, guiding engineers, and translating regulatory requirements into scalable data models.

Qualifications

• 5+ years in data/analytics or platform roles with leadership exposure.
• Azure/cloud data platform experience.
• Hands-on Databricks, Spark/PySpark, and SQL pipelines.
• Strong SQL, relational/NoSQL, data lakes, and performance tuning.
• Python with Pandas/NumPy for data manipulation.
• Experience with Power BI/Tableau/Looker for data visuals.
• Knowledge of data quality, lineage, governance and monitoring.
• Familiarity with ADF, Airflow, AWS Glue or similar tools.
• Git, CI/CD, and code review discipline.
• English at least B2+ level.

Responsibilities

• Provide technical leadership for traceability data platforms and pipelines.
• Define architecture, standards, and best practices for traceability solutions.
• Oversee robust pipelines, quality controls, and monitoring frameworks.
• Guide data engineers on implementation choices and optimisations.
• Contribute to run execution, data quality, lineage, and auditability.
• Translate regulatory requirements into data models and platform features.
• Collaborate with architects, data platform teams, and partners.
• Support adoption of traceability solutions by business and sustainability teams.

Skills

Leadership experience

SQL proficiency

Python (Pandas/NumPy)

English (B2+)

Cloud data platforms (Azure)

Tools

Databricks

Spark/PySpark

Power BI

Tableau

Looker

ADF

Airflow

AWS Glue

Git/CI-CD

Job description

EPAM Systems is seeking a Lead Data Software Engineer with Databricks expertise to drive the design and evolution of end-to-end traceability solutions across the supply chain. You will provide technical leadership for heterogeneous data assets and data products, ensuring regulatory compliance and data-driven decision making.

The role involves collaborating with solution architects and platform teams, guiding engineers, and translating regulatory requirements into scalable data models.