Azure Data Engineer

Ampstek; Sydney; On-site; AUD 170,000 - 210,000; Full time

Job summary

Ampstek is seeking an experienced Azure Data Engineer with 8–10 years of hands-on experience to design, develop, and support scalable data engineering solutions on Microsoft Azure. The role focuses on Synapse Analytics, Data Factory, SQL, PySpark, Python, and T‑SQL, with emphasis on ETL/ELT pipelines and data modelling.

The candidate will design and optimize data pipelines, build transformations, and implement scalable data solutions across large datasets and diverse sources.

Qualifications

• 8–10 years of relevant Data Engineering experience.
• Strong hands-on experience with Azure Synapse Analytics, ADF, and Azure SQL.
• Proficient with PySpark and Python programming.
• Advanced T-SQL / SQL skills.
• Experience with ETL/ELT development and data pipelines.
• Experience with data modelling and Star/Snowflake schemas.
• Understanding of Big Data processing and distributed computing.
• Design and implement scalable Azure data solutions.
• Ability to work with large datasets and diverse data sources.
• Strong problem-solving and collaboration skills.

Responsibilities

• Design, develop, and maintain scalable data engineering solutions on Azure.
• Develop and optimize ETL/ELT pipelines using Azure services.
• Build data transformations with PySpark and Python.
• Write and optimize complex T-SQL/SQL queries and stored procedures.
• Develop and maintain Star/Snowflake data models.
• Work with large datasets and distributed processing.
• Integrate data from structured and unstructured sources.
• Optimize pipelines for performance, scalability, and reliability.

Skills

Azure Synapse Analytics

Azure Data Factory

Azure SQL

PySpark

Python

T-SQL

ETL/ELT development

Star/Snowflake modelling

Big Data processing

Job description

We are looking for an experienced Azure Data Engineer with 8–10 years of relevant experience in designing, developing, and supporting scalable data engineering solutions on Microsoft Azure. The ideal candidate should have strong hands-on experience with Azure Synapse Analytics, Azure Data Factory, Azure SQL, PySpark, Python, and advanced T‑SQL.

Must-Have Skills

• Strong hands-on experience with Azure Synapse Analytics
• Strong experience with Azure Data Factory (ADF)
• Hands-on experience with Azure SQL
• Strong programming experience in PySpark and Python
• Advanced T‑SQL / SQL skills
• Strong understanding of ETL/ELT development and data pipelines
• Experience with data modelling, including Star and Snowflake schemas
• Good understanding of Big Data processing and distributed computing
• Experience designing and implementing scalable Azure data solutions
• 8–10 years of relevant Data Engineering experience

Key Responsibilities

• Design, develop, and maintain scalable data engineering solutions using Azure Synapse Analytics, Azure Data Factory, and Azure SQL.
• Develop and optimize complex ETL/ELT data pipelines using Azure services.
• Build data transformation and processing solutions using PySpark/Python.
• Write and optimize complex T‑SQL/SQL queries, stored procedures, and data transformations.
• Develop and maintain data models using Star and Snowflake schemas.
• Work with large datasets and implement efficient distributed data processing solutions.
• Perform data integration from multiple structured and unstructured data sources.
• Optimize data pipelines and queries for performance, scalability, and reliability