Data Engineer

Data#3; Sydney; On-site; AUD 90,000 - 120,000; Full time

Job summary

A technology consulting company in Sydney is seeking an experienced Data Engineer for an initial 3-month contract. You will design, build, and optimise ETL pipelines in an Azure environment, ensuring reliable data solutions. Strong expertise in Databricks, Spark SQL, and SQL is required. Applicants should have proven experience in data engineering within a cloud setup. Apply now with your updated resume.

Qualifications

• Proven experience as a Data Engineer or similar role in a cloud environment.
• Strong expertise in Databricks and Spark SQL, including joins and query optimisation.
• Hands-on experience with ETL development and pipeline orchestration.

Responsibilities

• Design, build, and maintain ETL pipelines using Databricks and Spark SQL.
• Develop and optimise SQL queries for large-scale data transformation.
• Collaborate with data and integration teams to align data flows.

Skills

ETL development

Databricks

Spark SQL

SQL

Azure data services

Problem-solving

Tools

Azure Data Factory

Job description

Overview:

We are seeking an experienced Data Engineer to join a large-scale program for an initial 3-month contract. The role will focus on building and optimising data pipelines in an Azure environment, working closely with technical teams to deliver efficient, high-quality data solutions.

Responsibilities:

• Design, build, and maintain ETL pipelines using Databricks and Spark SQL
• Develop and optimise SQL queries for large-scale data transformation and performance
• Extract and load data from source systems into Azure-based data warehouses and downstream platforms
• Collaborate with data and integration teams to align data flows and resolve issues
• Ensure data pipelines are reliable, efficient, and well-documented
• Support testing, troubleshooting, and performance tuning activities

Key Skills and Experience:

• Proven experience as a Data Engineer or similar role in a cloud environment
• Strong expertise in Databricks and Spark SQL, including joins and query optimisation
• Hands-on experience with ETL development and pipeline orchestration (Azure Data Factory desirable)
• Solid SQL skills and ability to work with large datasets
• Familiarity with Azure data services (Data Lake, Synapse, D365 exposure a bonus)
• Strong problem-solving skills and ability to work collaboratively within cross-functional teams

Interested candidates who meet the required skillset of the role are encouraged to apply via the link with an updated resume. Reference BIHI 113260

Seniority level

• Mid-Senior level

Employment type

• Contract

Job function

• Information Technology

Industries

• IT Services and IT Consulting