Lead Data Engineer

EPAM Systems; United States; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Great Place To Work 2024

Top 100 Best Places to Work 2023

Most Loved Workplace (Newsweek)

Job summary

EPAM Systems in Australia seeks a Lead Data Engineer to own end-to-end data modeling and pipeline delivery as a major enterprise data lake is re-architected. You will work hands-on with Databricks and dbt, partnering with US-based stakeholders and coordinating with an India-based engineering team.

You thrive on autonomy, clear documentation and strong ownership, delivering scalable datasets and data quality validations while supporting basic dashboards for validation and reporting.

Qualifications

• Dimensional modeling with star schema and fact/dimension design.
• Hands-on Python programming.
• Experience with Databricks and dbt including modular modelling and deployment.
• SQL for analytics-grade transformations.
• Experience with traditional ETL and modern cloud data stacks.
• Proven end-to-end delivery ownership across lifecycle stages.
• Clear communication and documentation habits for non-technical stakeholders.

Responsibilities

• Own dimensional data models from requirements through deployment.
• Design, build and maintain pipelines in Databricks and dbt for a modern data lake.
• Translate business needs into scalable datasets for reporting and analytics.
• Lead end-to-end delivery including testing and release coordination.
• Produce technical documentation in Confluence and data definitions.
• Collaborate with US-based stakeholders to align outcomes and scope.
• Coordinate with India-based engineering team across reviews and handovers.
• Support basic dashboards and data validation to ensure data quality.

Skills

Dimensional modeling

Python

Databricks

dbt

SQL

ETL / Data warehousing

End-to-end delivery

Documentation

Stakeholder engagement

Tools

Databricks

dbt

Job description

We are seeking a Lead Data Engineer to own end-to-end data modeling and pipeline delivery as a major enterprise data lake is re-architected. You will work hands-on with Databricks and dbt, partner closely with US-based stakeholders and collaborate with an India-based engineering team. You thrive with high autonomy, clear documentation and strong ownership.

Responsibilities

• Own dimensional data models from requirements through deployment using Kimball-aligned patterns
• Design, build and maintain pipelines in Databricks and dbt to support a modernised data lake
• Translate business requirements into scalable datasets, anticipating future reporting and analytics needs
• Lead end-to-end delivery including development, unit testing, UAT support and release coordination
• Produce clear technical documentation in Confluence and maintain decision records and data definitions
• Partner with US-based stakeholders to align outcomes, scope and delivery expectations
• Collaborate with an India-based engineering team to coordinate build, reviews and handovers
• Support basic dashboarding and validation to confirm data meets business expectations

Requirements

• Dimensional modeling capability including star schema, fact and dimension design and aggregate awareness
• Hands on experience with python programming
• Databricks experience for data engineering development and operational support dbt (data build tool) experience including modular modelling, testing and deployment practices
• SQL proficiency for analytics-grade transformations and performance-aware querying
• Traditional ETL and data warehousing foundation adapted to modern cloud data stacks
• End-to-end delivery ownership across requirements, build, testing, UAT and deployment
• Clear communication and strong documentation habits for non-technical stakeholder engagement
• Self-directed working style with comfort operating under light-touch leadership

Nice to have

• Experience re-architecting enterprise data lakes or data warehouses in multi-phase programs
• Familiarity with release planning across distributed teams and time zones
• Exposure to basic BI development or semantic layer design to support reporting consumption

We offer

• By choosing EPAM, you're getting a job at Great Place To Work-Certified in 2024, Glassdoor's Top 100 Best Places to Work in 2023 & one of Most Loved Workplace, as recognized by Newsweek, 2021 - 2023.
• Employee ideas are the main driver of our business. We have a very supportive environment where your voice matters.
• You will be challenged while working side-by-side with the best talent globally. We work with top-notch technologies, constantly seeking new industry trends and best practices.
• We offer a transparent career path and an individual roadmap to engineer your future & accelerate your journey.
• At EPAM, you can find vast opportunities for self-development: online courses and libraries, mentoring programs, partial grants of certification, and experience exchange with colleagues around the world. You will learn, contribute, and grow with us.

Life at EPAM

• We are a leading global provider of digital platform engineering and development services that has rapidly grown in Australia since 2013.
• We adopt a global growth strategy, thinking and acting like start-ups, working in multi-disciplinary teams, and delivering results. With a multinational talented team, we have been delivering innovative solutions for cloud migration, cyber security, digital transformation, etc.
• You will work in an open and friendly work environment where your professional skills and experience can stand out.