Lead Data Engineer: Azure Databricks & Pipelines

ALOIS UK

Perth

On-site

AUD 140,000 - 190,000

Full time

47 hours ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

ALOIS UK is seeking a Senior Data Engineer to design and deliver secure, scalable data solutions across on-premises and cloud platforms. You will lead complex pipelines, mentor engineers and promote reusable patterns to improve reliability and cost efficiency.

You will coordinate with multiple teams to ensure data assets meet business needs and governance requirements while driving performance and scalability improvements across the data platform.

Qualifications

  • Seven+ years of experience in data engineering or data warehousing.
  • Experience designing end-to-end data pipelines.
  • Strong SQL and Python; practical Spark experience.
  • At least two years with Azure Databricks.
  • Experience delivering cloud-based analytics and reporting pipelines.
  • Familiarity with batch and near-real-time processing.
  • Ability to mentor and lead data engineers.

Responsibilities

  • Lead design and delivery of production-grade data pipelines and assets across on-premises and cloud platforms.
  • Translate business needs into practical engineering solutions.
  • Own or lead ingestion, transformation, modelling, storage and data consumption designs.
  • Ensure non-functional requirements: security, reliability, performance, scalability and usability.
  • Promote reusable data engineering patterns and practices.
  • Review designs, mappings, test plans and deployment docs.
  • Provide technical mentoring and peer review for data engineers.

Skills

SQL
Python
Spark
Azure Databricks
Data modeling
Mentoring

Education

Bachelor's degree in Computer Science

Tools

Azure Databricks
Airflow
Control-M
Spark

Job description

ALOIS UK is seeking a Senior Data Engineer to design and deliver secure, scalable data solutions across on-premises and cloud platforms. You will lead complex pipelines, mentor engineers and promote reusable patterns to improve reliability and cost efficiency.

You will coordinate with multiple teams to ensure data assets meet business needs and governance requirements while driving performance and scalability improvements across the data platform.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Lead Data Platform Engineer - Azure Databricks (Hybrid)
Lead Data Platform Engineer - Azure Databricks (Hybrid)

shift • North Sydney

Hybrid
AUD 150,000 - 190,000
Hybrid working
Parental leave: up to 26 weeks
Strategy Week
+2
Senior Data Engineer: Cloud Data Lakes & Real-Time Pipelines
Senior Data Engineer: Cloud Data Lakes & Real-Time Pipelines

Work Initiatives • North Sydney

On-site
AUD 150,000 - 210,000
Lead Data Engineer, Azure Databricks Platform (Hybrid)
Lead Data Engineer, Azure Databricks Platform (Hybrid)

Shift Financial Pty • Sydney

Hybrid
AUD 150,000 - 190,000
Hybrid working
Parental leave
Strategy Week
+2
Senior Data Engineer - Azure Databricks Platform Lead
Senior Data Engineer - Azure Databricks Platform Lead

Shift Financial • Sydney

Hybrid
AUD 140,000 - 190,000
Parental leave
Hybrid working
Strategy Week
+2
Lead Data Platform Engineer — Azure Databricks, Hybrid
Lead Data Platform Engineer — Azure Databricks, Hybrid

Shift • Sydney

Hybrid
AUD 150,000 - 190,000
Hybrid work policy
Parental leave up to 26 weeks
Strategy Week
+2
Lead Data Engineer: Pipelines, Modeling & AI Insights
Lead Data Engineer: Pipelines, Modeling & AI Insights

TT-Engineering • Sydney

Hybrid
AUD 150,000 - 190,000
Flexible hybrid working
Global career pathways
Continuous learning
+2
Senior Azure Data Engineer: Pipelines & Analytics
Senior Azure Data Engineer: Pipelines & Analytics

Tech Mahindra Limited • Sydney

On-site
AUD 130,000 - 180,000
Azure Data Engineer
Azure Data Engineer

Tech Mahindra Limited • Sydney

On-site
AUD 130,000 - 180,000
Databricks Data Engineer: Cloud Lakehouse & Pipelines
Databricks Data Engineer: Cloud Lakehouse & Pipelines

Ingrity Pty • Sydney

Hybrid
AUD 120,000 - 180,000
Hybrid work environment
Senior Data Engineer: SageMaker Studio Pipelines
Senior Data Engineer: SageMaker Studio Pipelines

ALOIS UK • Perth

On-site
AUD 130,000 - 170,000
Top locations