Senior Data Engineer: Lakehouse & Real-Time Pipelines

Domain; Sydney; On-site; AUD 140,000 - 180,000; Full time

Benefits offered by this job

Extra days of annual leave

Leadership development programs

LinkedIn Learning

Perkbox discounts

Job summary

Domain is seeking a Senior Data Engineer - Product to design and operate data platform capabilities for batch and streaming pipelines across Domain-CoStar in APAC. You’ll work on a Lakehouse with AWS, Snowflake and Databricks, delivering data-driven insights for multiple internal teams.

You will collaborate with data scientists, analysts and product managers to drive value while advancing cloud-native data warehousing practices and cost efficiency.

Qualifications

• 5+ years of hands-on software or data engineering
• 4+ years in SQL and Python
• Experience with Airflow, DBT, AWS Glue
• Cloud data platforms such as Snowflake, Databricks, Lakehouse
• Experience on AWS cloud infrastructure
• Experience working with semi-structured/unstructured data
• Strong data modelling skills in agile environment
• Hands-on experience building streaming and real-time pipelines with Kafka and Flink
• Knowledge of infrastructure-as-code tools such as CDK, CloudFormation, or Terraform
• Degree in computer science, engineering, mathematics, statistics, or related field

Responsibilities

• Design and build reusable, scalable data solutions on a Lakehouse platform
• Build and maintain pipelines using DBT, Airflow, Snowflake, Databricks and AWS services
• Develop real-time data pipelines with Apache Kafka and Apache Flink
• Connect to various data sources via SaaS, APIs, direct connections, and streaming
• Architect data solutions on AWS, Snowflake and Databricks
• Optimize Lakehouse table formats and manage schema evolution
• Apply modern data modelling in an agile environment
• Write and optimise SQL and Spark workloads for efficiency
• Collaborate with data scientists, analysts, product managers, and engineers
• Proactively identify opportunities to improve data processes and reduce costs

Skills

SQL

Python

Data modeling

Kafka

Flink

ETL

Education

Bachelors in CS/Engineering

Tools

DBT

Airflow

Snowflake

Databricks

AWS Glue

Job description

Domain is seeking a Senior Data Engineer - Product to design and operate data platform capabilities for batch and streaming pipelines across Domain-CoStar in APAC. You’ll work on a Lakehouse with AWS, Snowflake and Databricks, delivering data-driven insights for multiple internal teams.

You will collaborate with data scientists, analysts and product managers to drive value while advancing cloud-native data warehousing practices and cost efficiency.