Senior Databricks Data Engineer: End-to-End Pipelines

Balance Recruitment and Balance Consulting; New South Wales; On-site; AUD 180,000 - 230,000; Full time

Benefits offered by this job

Great Place to Work

Greenfield project

Career development

Job summary

Balance Recruitment and Balance Consulting seeks a Senior Data & Analytics Engineer to design and implement robust data pipelines in Databricks, with a focus on data modelling for multiple business workstreams in Western Sydney. You will lead end-to-end data engineering, optimise performance of Spark jobs, and build scalable solutions for sales, operations, marketing and finance reporting.

A hands-on role requiring strong Python (PySpark) and SQL skills and ability to deliver trusted data for

Qualifications

• Experience designing end-to-end data pipelines in Databricks.
• Strong data modelling skills including star/snowflake schemas.
• Proficient in Python and SQL for data engineering tasks.

Responsibilities

• Design, build and maintain scalable data pipelines in Databricks (PySpark/SQL).
• Develop robust data models unifying ERP and other data sources.
• Implement BI layers to enable accurate, single-source reporting.

Skills

Data Modelling

Python (PySpark)

SQL

Tools

Databricks

BI Tool

Job description

Balance Recruitment and Balance Consulting seeks a Senior Data & Analytics Engineer to design and implement robust data pipelines in Databricks, with a focus on data modelling for multiple business workstreams in Western Sydney. You will lead end-to-end data engineering, optimise performance of Spark jobs, and build scalable solutions for sales, operations, marketing and finance reporting.

A hands-on role requiring strong Python (PySpark) and SQL skills and ability to deliver trusted data for