Senior Data Engineer - Product

CoStar Group, Inc.; Sydney; On-site; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Extra days of annual leave

Leadership development programs

LinkedIn Learning

Perkbox discounts

Job summary

CoStar Group’s Domain unit in Australia is seeking a Senior Data Engineer to design, build and operate a data platform for batch and streaming pipelines on a Lakehouse, serving data product, data science and analytics teams.

You will work with Snowflake, Databricks, Apache Kafka and Apache Flink on AWS to optimise cost, improve data quality and enable data-driven decisions across the business while collaborating with engineers, analysts and product managers.

Qualifications

• At least 5+ years of hands‑on commercial experience in software or data engineering.
• 4+ years of strong development experience in SQL and Python.
• Proven experience with data integration and orchestration tools, including Apache Airflow, DBT, and AWS Glue.
• Expert on modern cloud data platforms and architectures, such as Snowflake, Databricks, and Lakehouse architecture; Experience designing and building data solutions on AWS.
• Experience with semi‑structured and unstructured data.
• Strong data modelling skills in an agile environment.
• Hands‑on experience building streaming and real‑time pipelines with Apache Kafka and Apache Flink.
• Knowledge of infrastructure‑as‑code tools such as CDK, CloudFormation, or Terraform.
• Degree in computer science, engineering, mathematics, statistics, or related field

Responsibilities

• Design and build scalable data solutions and assets on a Lakehouse platform.
• Build and maintain pipelines using DBT, Airflow, Snowflake, Databricks and AWS services.
• Develop real-time data pipelines with Kafka and Flink for low-latency use cases.
• Connect to diverse sources (SaaS, APIs, direct connections, streaming) on cloud architecture.
• Architect and implement data solutions on AWS, Snowflake and Databricks ensuring cost‑efficiency.
• Build and optimise Lakehouse table formats such as Iceberg.
• Apply modern data modelling practices in an agile environment.
• Write and optimise SQL and Spark workloads for performance and cost.
• Collaborate with data scientists, analysts, product managers and engineers.
• Identify opportunities to improve data processes and reliability.

Skills

SQL

Python

Airflow

DBT

AWS Glue

Snowflake

Databricks

Lakehouse

Kafka

Flink

Infra as Code

Data modelling

Education

Degree in computer science, engineering, mathematics, statistics, or a related technical field

Tools

Apache Airflow

DBT

AWS Glue

Snowflake

Databricks

Job description

Senior Data Engineer - Product

Job Description

Exciting opportunity for a Senior Data Engineer to join Domain – CoStar in a period of great opportunity and growth. You will have a direct impact on the continued success of Domain‑CoStar in the APAC region. Leveraging the largest reality data sets in the local market, to enhance Domain‑CoStar’s product service offering and refine internal business practices. The purpose of this role is to build data platform capabilities for batch and streaming pipelines on our Lakehouse and develop data assets that serve as the source and authority for data-driven decisions and analytics used across the business. You will design, develop and operate a data platform and data pipelines which serve Domain’s products and internal data teams like data product, data science, data analytics and ML/AI.

What you’ll do

Solution Design

Design and build re-usable, scalable data solutions and assets on a modern Lakehouse platform across a constantly evolving landscape of products and internal data teams.

Pipeline Development

Build and maintain robust, reliable pipelines using DBT, Apache Airflow, Snowflake, Databricks and AWS services.

Streaming & Real-Time

Develop real-time data pipelines using Apache Kafka and Apache Flink to support low-latency, event-driven use cases.

Data Integration

Connect to a wide variety of internal and external sources via multiple methods (SaaS solutions, APIs, direct connections, streaming) on cloud architecture.

Cloud Data Architecture

Architect and implement data solutions on AWS, Snowflake and Databricks, applying best practices for cloud-native data warehousing and cost-efficiency.

Lakehouse Architecture

Build and optimise open Lakehouse table formats such as Apache Iceberg, managing schema evolution, partitioning, and performance.

Modern Data Modelling

Apply modern data modelling practices that evolve with the business in an agile environment.

Performance & Cost

Write and optimise complex SQL and Spark workloads to keep solutions efficient in both time and cost.

Data quality and governance

Cross-functional Partnership

Work closely with data scientists, analysts, product managers, and engineers across the Domain Group to deliver data solutions that drive business value.

Continuous Improvement

Challenge the status quo — proactively identify opportunities to improve data processes, reduce costs, and increase reliability.

Essential

• At least 5+ years of hands‑on commercial experience in software or data engineering.
• 4+ years of strong development experience in SQL and Python.
• Proven experience with data integration and orchestration tools, including Apache Airflow, DBT, and AWS Glue.
• Expert on some of the modern cloud data platforms and architectures, such as Snowflake, Databricks, and Lakehouse architecture Experience designing and building data solutions on AWS cloud infrastructure.
• Experience working with semi‑structured and unstructured data.
• Strong data modelling skills with the ability to evolve models in an agile environment.
• Hands‑on experience building streaming and real‑time pipelines with Apache Kafka and Apache Flink.
• Knowledge of infrastructure‑as‑code tools such as CDK, CloudFormation, or Terraform.
• Degree in computer science, engineering, mathematics, statistics, or a related technical field

What’s In It For You?

• Working at CoStar Group means you'll enjoy a culture of collaboration and innovation that attracts the best and brightest across a broad range of disciplines.
• We offer you generous compensation and performance‑based incentives.
• As well as having an outstanding working environment, other perks include extra days of annual leave, leadership development programs, LinkedIn Learning, Perkbox discounts and much more!

About Domain (part of the CoStar Group)

Domain is a leading property technology and services marketplace that is home to one of the largest portfolios of property brands in Australia, including the Domain, Allhomes and Commercial Real Estate (CRE) platforms. In 2025, Domain became part of CoStar Group - a global leader in commercial real estate information, analytics, online marketplaces and 3D digital twin technology. We are dedicated to digitising the world’s real estate, empowering all people to discover properties, insights, and connections that improve their businesses and lives.

Equity, Diversity & Inclusion Domain is enthusiastically and unapologetically committed to fostering an equitable, inclusive work culture which reflects our customers and communities. We are proactively looking for candidates from all lived experiences, including people with disability, and people of all ages, ethnicities, cultures (including Aboriginal and Torres Strait Islander Peoples), faiths, sexual orientations, and gender identities (including trans and non-binary people). We are committed to providing an equitable recruitment process for people with disability. If you require adjustments during the process we’re here to support. If you wish to receive this job advertisement in an accessible format, or have a confidential chat about workplace adjustments, please contact our Equity, Diversity and Inclusion team at [e-mail] or leave a message on 1300 858 356 and we will get back to you.

CoStar Group is an Equal Employment Opportunity Employer; we maintain a drug‑free workplace and perform pre-employment substance abuse testing CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize the world’s real estate, empowering all people to discover properties, insights and connections that improve their businesses and lives. We have been living and breathing the world of real estate information and online marketplaces for over 37 years, giving us the perspective to create truly unique and valuable products and services. We’ve continually refined, transformed and perfected our approach to our business, creating a language that has become standard in our industry and for our customers. This is how we deliver for our customers, our employees, and investors. By equipping the brightest minds with the best resources available, we provide an invaluable edge in real estate.

CoStar Group is committed to creating a diverse environment and is proud to be an equal opportunity workplace and affirmative action employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, disability, age, or veteran status. CoStar Group is also committed to compliance with all fair employment practices regarding citizenship and immigration status. If you are a qualified individual with a disability or a disabled veteran, you may request a reasonable accommodation if you are unable or limited in your ability to use or access www.costargroup.com/careers as a result of your disability. You can request reasonable accommodations by sending an email to [e-mail].