Lead Data Engineer for Modern Data Lake & Databricks

EPAM Systems; United States; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Great Place To Work 2024

Top 100 Best Places to Work 2023

Most Loved Workplace (Newsweek)

Job summary

EPAM Systems in Australia seeks a Lead Data Engineer to own end-to-end data modeling and pipeline delivery as a major enterprise data lake is re-architected. You will work hands-on with Databricks and dbt, partnering with US-based stakeholders and coordinating with an India-based engineering team.

You thrive on autonomy, clear documentation and strong ownership, delivering scalable datasets and data quality validations while supporting basic dashboards for validation and reporting.

Qualifications

• Dimensional modeling with star schema and fact/dimension design.
• Hands-on Python programming.
• Experience with Databricks and dbt including modular modelling and deployment.
• SQL for analytics-grade transformations.
• Experience with traditional ETL and modern cloud data stacks.
• Proven end-to-end delivery ownership across lifecycle stages.
• Clear communication and documentation habits for non-technical stakeholders.

Responsibilities

• Own dimensional data models from requirements through deployment.
• Design, build and maintain pipelines in Databricks and dbt for a modern data lake.
• Translate business needs into scalable datasets for reporting and analytics.
• Lead end-to-end delivery including testing and release coordination.
• Produce technical documentation in Confluence and data definitions.
• Collaborate with US-based stakeholders to align outcomes and scope.
• Coordinate with India-based engineering team across reviews and handovers.
• Support basic dashboards and data validation to ensure data quality.

Skills

Dimensional modeling

Python

Databricks

dbt

SQL

ETL / Data warehousing

End-to-end delivery

Documentation

Stakeholder engagement

Tools

Databricks

dbt

Job description

EPAM Systems in Australia seeks a Lead Data Engineer to own end-to-end data modeling and pipeline delivery as a major enterprise data lake is re-architected. You will work hands-on with Databricks and dbt, partnering with US-based stakeholders and coordinating with an India-based engineering team.

You thrive on autonomy, clear documentation and strong ownership, delivering scalable datasets and data quality validations while supporting basic dashboards for validation and reporting.