Senior Data Engineer - Databricks Platform Lead

Technology CII; Western Australia; On-site; AUD 140,000 - 190,000; Full time

Job summary

Technology CII in Australia is seeking a Senior Data Engineer to design, build, and optimise enterprise-scale data platforms and pipelines. This role blends hands-on engineering with solution architecture and technical leadership, with a strong focus on mentoring internal teams and driving engineering best practices.

You will design scalable ETL/ELT pipelines with Databricks/Spark, build enterprise-grade data solutions, and lead data migration and transformation strategies across cloud-based

Qualifications

• Design and build scalable ETL/ELT pipelines using Databricks and Spark.
• Build and maintain enterprise-grade data platform solutions.
• Architect data migration, integration, and transformation strategies.
• Develop data ingestion frameworks from databases, APIs, and streaming sources.
• Transform complex and semi-structured datasets into curated data products.
• Implement orchestration, monitoring, and automated deployment processes.
• Establish engineering standards, governance frameworks, and best practices.
• Mentor and coach internal data engineers to improve technical capability.

Responsibilities

• Design and develop scalable ETL/ELT pipelines using Databricks and Spark.
• Build and maintain enterprise-grade data platform solutions.
• Architect data migration, integration, and transformation strategies.
• Develop data ingestion frameworks from databases, APIs, and streaming sources.
• Transform complex and semi-structured datasets into curated data products.
• Implement orchestration, monitoring, and automated deployment processes.
• Establish engineering standards, governance frameworks, and best practices.
• Mentor and coach internal data engineers to improve technical capability.

Skills

Advanced SQL

Python development

Databricks

Apache Spark

Delta Lake

CI/CD

Airflow

dbt

Mentoring/leadership

Communication

Tools

Databricks

Apache Spark

Delta Lake

Airflow

dbt

Job description

Technology CII in Australia is seeking a Senior Data Engineer to design, build, and optimise enterprise-scale data platforms and pipelines. This role blends hands-on engineering with solution architecture and technical leadership, with a strong focus on mentoring internal teams and driving engineering best practices.

You will design scalable ETL/ELT pipelines with Databricks/Spark, build enterprise-grade data solutions, and lead data migration and transformation strategies across cloud-based