Senior Data Engineer - Lakehouse & Real-Time Data

CoStar Group; New South Wales; On-site; AUD 140,000 - 190,000; Full time

Benefits offered by this job

Extra days of annual leave

Leadership development programs

LinkedIn Learning

Perkbox discounts

Job summary

Domain is a leading property technology and services marketplace and part of CoStar Group. We seek a Senior Data Engineer to build data platform capabilities for batch and streaming pipelines on our Lakehouse, serving data products, analytics and ML teams.

You will design, develop and operate data pipelines across AWS, Snowflake and Databricks, enabling data-driven decisions for Domain‑CoStar in the APAC region. Join a growth phase with collaboration across product and data science teams.

Qualifications

• At least 5+ years of hands-on commercial experience in software or data engineering.
• Proven experience with data integration and orchestration tools (Airflow, DBT, AWS Glue).
• Strong cloud data platform knowledge (Snowflake, Databricks, Lakehouse).
• Experience designing data solutions on AWS infrastructure.
• Experience with semi-structured/unstructured data.
• Strong data modelling in agile environments.
• Hands-on experience with streaming pipelines (Kafka, Flink).
• IaC knowledge (CDK, CloudFormation, or Terraform).
• Degree in computer science, engineering, mathematics, statistics, or related field.

Responsibilities

• Design and build reusable, scalable data solutions and assets on a modern Lakehouse platform across evolving products and teams.
• Build and maintain robust pipelines using DBT, Airflow, Snowflake, Databricks and AWS services.
• Develop real-time data pipelines using Kafka and Flink for low-latency use cases.
• Connect to diverse sources via APIs, SaaS, direct connections, and streaming on cloud.
• Architect data solutions on AWS, Snowflake and Databricks with cost efficiency.
• Build and optimise Lakehouse table formats like Apache Iceberg, manage schema evolution.
• Apply modern data modelling practices in an agile environment.
• Write and optimise SQL and Spark workloads for performance and cost.
• Collaborate with data scientists, analysts, product managers, and engineers to deliver value.
• Continuously improve data processes to reduce costs and increase reliability.

Skills

SQL

Python

Airflow

DBT

AWS

Snowflake

Databricks

Kafka

Flink

Terraform/CDK

Data modeling

APAC experience

Education

Bachelor's degree in computer science or related field

Tools

Apache Airflow

Snowflake

Databricks

AWS Glue

Job description

Domain is a leading property technology and services marketplace and part of CoStar Group. We seek a Senior Data Engineer to build data platform capabilities for batch and streaming pipelines on our Lakehouse, serving data products, analytics and ML teams.

You will design, develop and operate data pipelines across AWS, Snowflake and Databricks, enabling data-driven decisions for Domain‑CoStar in the APAC region. Join a growth phase with collaboration across product and data science teams.