Contract Azure Data Engineer - SQL & PySpark Pipelines

Randstad; Maroochydore; On-site; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Udemy license for learning

Exclusive discounts

Private health fund discounts

3 payruns a week

Job summary

Randstad is seeking a Data Engineer / SQL Developer for a short-term contract based in Maroochydore, Sunshine Coast. The role focuses on enhancing data-driven decision-making by building scalable data pipelines, extracting and transforming data, and managing complex SQL views.

The ideal candidate will have advanced SQL, strong Azure experience (Synapse, Data Factory, Data Lake, SQL, Storage), PySpark, and Azure DevOps expertise, with a proven track record in data governance and CI/CD practices.

Qualifications

• Experience with advanced SQL for data extraction, transformation and pipeline optimization.
• Proven experience with Microsoft Azure cloud services (Synapse, Data Factory, Data Lake, SQL, Storage).
• Solid knowledge of CI/CD practices and version control.
• Ability to design scalable data pipelines and complex SQL views.

Responsibilities

• Write complex SQL queries to extract, manipulate, and analyze data across cloud and on-prem environments.
• Design, build, and maintain scalable enterprise data pipelines from diverse sources.
• Develop complex data views tailored to business needs while upholding data integrity and governance.
• Collaborate with data analysts and BI to deliver accessible, high-quality data.
• Utilize Azure services, Azure DevOps, and PySpark notebooks to implement version control and analytics workflows.

Skills

Advanced SQL

Azure

PySpark

Data pipelines

CI/CD

Data governance

Tools

Azure Synapse

Azure Data Factory

Azure Data Lake

Azure SQL

Azure Storage

Azure DevOps

PySpark notebooks

Job description

Randstad is seeking a Data Engineer / SQL Developer for a short-term contract based in Maroochydore, Sunshine Coast. The role focuses on enhancing data-driven decision-making by building scalable data pipelines, extracting and transforming data, and managing complex SQL views.

The ideal candidate will have advanced SQL, strong Azure experience (Synapse, Data Factory, Data Lake, SQL, Storage), PySpark, and Azure DevOps expertise, with a proven track record in data governance and CI/CD practices.