Data Engineer

Sirius.

Melbourne

Hybrid

AUD 140,000 - 180,000

Full time

3 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Hybrid working model
Professional development budget

Job summary

Sirius. in Melbourne is seeking a mid-to-senior Databricks Data Engineer to help transform our data capabilities and scale a lakehouse-centric platform. You will design robust data pipelines and contribute to governance, security, and CI/CD practices.

Join a data-driven enterprise with a strong cloud footprint, a hybrid work model (3 days in Melbourne CBD, 2 days remote), and opportunities to influence design decisions and analytics strategy.

Qualifications

  • 3-5+ years of dedicated Data Engineering experience in production environments.
  • Deep hands-on Databricks, Python (PySpark) and SQL expertise.
  • Experience with major public cloud ecosystems; Azure Databricks/ADLS Gen2 preferred, AWS welcomed.
  • Strong Git, CI/CD, testing frameworks, and software engineering practices for data.
  • Ability to communicate complex technical concepts to non-technical stakeholders.

Responsibilities

  • Designing and building high-performance batch and streaming data pipelines using PySpark, SQL, and Databricks.
  • Championing Medallion architecture (Bronze, Silver, Gold) on Delta Lake for data quality.
  • Implementing data governance, access controls, and lineage tracking with Unity Catalog.
  • Managing complex workflows with Lakeflow/Workflows or tools like Airflow or ADF.
  • Tuning compute, cost-efficiency, and establishing CI/CD pipelines for deployments.
  • Partnering with cross-functional teams to translate business requirements into scalable data solutions.

Skills

Databricks
PySpark
SQL
CI/CD
Git
Data pipelines
Cloud platforms

Tools

Delta Lake
Unity Catalog
Airflow
Lakeflow
ADF

Job description

The Opportunity

Are you a Databricks champion looking to leave your mark on a modern, enterprise-scale data ecosystem?

I am partnering exclusively with a highly respected, data-driven enterprise based in Melbourne. They are currently undergoing a massive transformation of their data capabilities and are heavily investing in the Databricks Lakehouse architecture to power their next generation of advanced analytics and machine learning initiatives.

Due to continuous growth, they are looking for a mid-to-senior Databricks Data Engineer to join their high-performing data team. This is not a "maintain the status quo" role, you will have a loud voice in design decisions and play a critical part in building robust, scalable data pipelines from the ground up.

Please note: You must hold PR, or be an Australian Citizen for this role.

What You Will Be Doing

As a core member of the data engineering squad, you will sit at the intersection of data science, analytics, and platform engineering. Your day-to-day will involve:

  • Designing and Building: Developing high-performance batch and streaming data pipelines utilising PySpark, SQL, and the Databricks ecosystem.
  • Lakehouse Architecture: Championing and implementing the Medallion architecture (Bronze, Silver, Gold) on Delta Lake to ensure pristine data quality for downstream consumers.
  • Data Governance: Implementing robust access controls, security policies, and data lineage tracking using Databricks Unity Catalog.
  • Orchestration: Managing and automating complex workflows using Databricks Lakeflow (Workflows) or adjacent orchestration tools like ADF/Airflow.
  • DevOps & Optimization: Tuning cluster compute for performance and cost-efficiency, and setting up rock-solid CI/CD pipelines for automated deployments.
  • Stakeholder Engagement: Partnering with cross-functional teams to translate complex business requirements into elegant technical solutions.
Technical Requirements

My client is looking for a proactive problem-solver who takes pride in writing clean, efficient code. You will need:

  • Proven Experience: 3-5+ years of dedicated Data Engineering experience with a history of delivering complex data solutions in production environments.
  • Technical Mastery: Deep, hands-on expertise in the Databricks platform, alongside advanced proficiency in Python (PySpark) and SQL.
  • Cloud Native: Strong experience working within a major public cloud ecosystem (Azure Databricks and ADLS Gen2 is highly preferred, but AWS is also welcomed).
  • Engineering Best Practices: A strong grasp of Git, CI/CD, testing frameworks, and modern software engineering principles applied to data.
  • Communication Skills: The ability to explain complex technical concepts to non-technical stakeholders clearly and concisely.
  • Bonus points: Holding an active Databricks Data Engineer Associate/Professional certification or having hands-on experience with MLflow.
Why Join This Client?
  • Impact & Ownership: Work on high-visibility projects where your technical decisions will directly shape the future data landscape of a major organisation.
  • Tech-First Culture: Join a business that views data as its core asset, meaning you will always have access to modern tools and training.
  • Growth: A generous professional development budget tailored to getting you certified in advanced cloud and Databricks competencies.
  • Flexibility: A genuine commitment to work-life balance, offering a mature hybrid working model (3 days in their modern Melbourne CBD office, 2 days remote).
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Databricks
Data Engineer - Databricks

TalentReady • Sydney

Hybrid
AUD 120,000 - 170,000
Data Engineer, Databricks
Data Engineer, Databricks

Lumiq Talent • Brisbane

Hybrid
AUD 167,000 - 204,000
Hybrid work
Staff benefits and discounts
Wellbeing support
Data Engineer - Databricks
Data Engineer - Databricks

Ingrity • Sydney, Brisbane

Hybrid
AUD 120,000 - 180,000
Data Engineer - Databricks
Data Engineer - Databricks

Ingrity Pty • Sydney

Hybrid
AUD 120,000 - 180,000
Hybrid work environment
Senior Data Engineer
Senior Data Engineer

DX1 • Melbourne

On-site
AUD 160,000 - 230,000
Senior Data Engineer
Senior Data Engineer

Cox Purtell • Sydney

On-site
AUD 150,000 - 220,000
Senior Data Engineer
Senior Data Engineer

Cox Purtell • Sydney

On-site
AUD 150,000 - 220,000
Senior Data Engineer | Databricks
Senior Data Engineer | Databricks

Vivanti Consulting • Brisbane

On-site
AUD 150,000 - 190,000
Mentoring Program
Paid Certifications
Hackathons
+3
Solutions Architect – Data Intelligence & Cloud Analytics
Solutions Architect – Data Intelligence & Cloud Analytics

Databricks Inc. • Melbourne

On-site
AUD 180,000 - 240,000
Data Engineer: Databricks & Cloud Analytics Leader
Data Engineer: Databricks & Cloud Analytics Leader

Mane Consulting • Melbourne

On-site
AUD 120,000 - 160,000
Top locations