Senior Data Engineer: Lead End-to-End Pipelines on Azure

ALOIS Australia

Sydney

Presencial

AUD 180.000 - 230.000

Jornada completa

hace 14 horas
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Descripción de la vacante

ALOIS Australia is seeking a Senior Data Engineer to lead the design and delivery of secure, scalable data solutions across on-premises and cloud platforms in Sydney.

You will provide technical leadership, designing batch and near-real-time pipelines and integrating data into trusted data assets for reporting, analytics and downstream applications. You will mentor other data engineers and help establish reusable engineering patterns to improve platform reliability and cost efficiency.

Formación

  • Seven or more years of experience in data engineering or data warehousing.
  • Strong track record delivering end-to-end data solutions.
  • Experience with SQL, Python, Spark, and Databricks.
  • Experience designing cloud-based analytics or reporting pipelines.
  • Experience with batch and near-real-time processing.
  • Experience with data profiling, ETL/ELT, and source-to-target mappings.
  • Experience with orchestration tools like Airflow or similar.
  • CI/CD, version control, automated testing and release-management practices.
  • Experience with JSON, XML and Avro data formats.
  • Demonstrated ability to lead, mentor engineers and influence technology decisions.
  • Azure data services and cloud data warehouse technologies.
  • Industry certifications in Azure, Databricks or related platforms.

Responsabilidades

  • Lead the design and delivery of complex, production-grade data pipelines and data assets across Azure, Databricks and on-premises platforms.
  • Translate product priorities and business requirements into practical engineering solutions.
  • Own or lead ingestion, transformation, modelling, storage and data consumption designs.
  • Ensure solutions meet security, reliability, performance and scalability requirements.
  • Optimise cloud and platform usage to balance performance and costs.
  • Promote reusable data engineering patterns and best practices.
  • Review designs, mappings, test strategies and release plans.
  • Lead data profiling, wrangling and analysis for new datasets.
  • Collaborate with SMEs to ensure data assets meet business needs.
  • Design data products for reporting, analytics and downstream apps.
  • Coordinate planning, governance, architecture and release activities across teams.
  • Ensure pipelines meet SLAs and monitoring/operational requirements.
  • Lead resolution of complex production issues and drive improvements.
  • Provide mentoring and peer reviews for data engineers.
  • Contribute to roadmaps, risk management and continuous improvement.

Conocimientos

Advanced SQL
Python
Data modeling
Problem solving
Technical leadership
Mentoring
Batch processing
Streaming / near-real-time
Data profiling
ETL/ELT design
CI/CD
Version control
Testing

Educación

Degree in Computer Science, Mathematics, Statistics or related

Herramientas

Azure Databricks
Spark
Airflow
Control-M
HDFS
Hive
Impala
Cloudera
JSON / XML / Avro
REST APIs
Kafka / streaming frameworks

Descripción del empleo

ALOIS Australia is seeking a Senior Data Engineer to lead the design and delivery of secure, scalable data solutions across on-premises and cloud platforms in Sydney.

You will provide technical leadership, designing batch and near-real-time pipelines and integrating data into trusted data assets for reporting, analytics and downstream applications. You will mentor other data engineers and help establish reusable engineering patterns to improve platform reliability and cost efficiency.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Lead Data Engineer: Azure Databricks & Pipelines
Lead Data Engineer: Azure Databricks & Pipelines

ALOIS UK • Perth

Presencial
AUD 140.000 - 190.000
Senior Data Engineer - Lead Scalable Pipelines & Real-Time
Senior Data Engineer - Lead Scalable Pipelines & Real-Time

Xpt Software Australia Pty • New South Wales

Presencial
AUD 140.000 - 180.000
Senior Data Engineer - Secure Cloud Data Pipelines (Azure)
Senior Data Engineer - Secure Cloud Data Pipelines (Azure)

Showtime Consulting Pty Ltd • Sydney

Híbrido
AUD 120.000 - 180.000
Senior Azure Data Engineer: Pipelines & Analytics
Senior Azure Data Engineer: Pipelines & Analytics

Tech Mahindra Limited • Sydney

Presencial
AUD 130.000 - 180.000
Senior Data Engineer: Build Scalable Cloud Pipelines
Senior Data Engineer: Build Scalable Cloud Pipelines

seek.com.au • Sydney

Presencial
AUD 120.000 - 180.000
Senior Data Engineer - AI Data Fabric & Pipelines (Hybrid)
Senior Data Engineer - AI Data Fabric & Pipelines (Hybrid)

Firmus Technologies Pty Ltd. • Sydney

Híbrido
AUD 140.000 - 190.000
Monthly Lifestyle Allowance
Novated Leasing
Parental Leave
Lead Data Pipeline & Platform Engineer
Lead Data Pipeline & Platform Engineer

53 Stations • Canberra

Presencial
AUD 140.000 - 190.000
Azure Data Engineer: Scalable Pipelines & Data Platform
Azure Data Engineer: Scalable Pipelines & Data Platform

Zone IT Solutions • Sydney

Presencial
AUD 150.000 - 190.000
Senior Data & Analytics Engineer: Platform Ownership
Senior Data & Analytics Engineer: Platform Ownership

The Recruitment Company (Australia) • Sydney

Presencial
AUD 140.000 - 210.000
Senior Data Engineer: Build Scalable Data Pipelines in the Cloud
Senior Data Engineer: Build Scalable Data Pipelines in the Cloud

Equal Experts • Sydney

Híbrido
AUD 120.000 - 160.000
Ubicaciones