Cloud-Native Data Engineer | AWS, Spark & Pipelines

Umbrella Club; Sydney; On-site; AUD 110,000 - 170,000; Full time

Job summary

Umbrella Club in Sydney is seeking an experienced Data Engineer to join a team dedicated to building and supporting scalable, cloud-native data platforms. You will design, develop and support data pipelines using AWS services and Spark/PySpark, with a strong emphasis on data modelling, governance and CI/CD practices.

The role requires hands-on SQL and Python, experience with CDC and operational databases, and collaboration with stakeholders in an Agile delivery environment.

Qualifications

• Hands-on SQL and Python experience.
• Experience with CDC and operational databases.
• Design, develop and support cloud-native data pipelines.
• Ability to collaborate with stakeholders in an Agile delivery environment.

Responsibilities

• Design, develop and support scalable data pipelines.
• Build and maintain cloud-native data platforms on AWS.
• Focus on data modelling, governance and CI/CD practices.
• Collaborate with stakeholders in an Agile environment.

Skills

SQL

Python

Data modelling

Governance

CI/CD

Agile delivery

Tools

AWS

Spark

PySpark

CDC

Job description

Umbrella Club in Sydney is seeking an experienced Data Engineer to join a team dedicated to building and supporting scalable, cloud-native data platforms. You will design, develop and support data pipelines using AWS services and Spark/PySpark, with a strong emphasis on data modelling, governance and CI/CD practices.

The role requires hands-on SQL and Python, experience with CDC and operational databases, and collaboration with stakeholders in an Agile delivery environment.