Senior ETL Automation Engineer: Azure Data Pipelines QA

Indium; Albury City; On-site; AUD 130,000 - 170,000; Full time

Job summary

Indium is seeking an ETL Automation Engineer with 10+ years of experience to lead end-to-end data pipeline testing on Azure platforms and to develop automated QA frameworks. The role requires strong SQL, data validation, and cross-functional collaboration across the SDLC in a fast-paced, multi-cloud environment.

Deep expertise in Azure Synapse, ADF, Databricks, and SQL Server, plus Python, PySpark, and CI/CD tooling is essential.

Qualifications

• 10+ years of experience in ETL automation and QA.

Responsibilities

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes.
• Monitor pipeline executions across environments and report failures/issues.
• Design and implement automated testing frameworks for data and volume testing.
• Validate complex business logic and data transformations using advanced SQL queries.
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery.
• Create and maintain test plans, test data, and QA documentation.
• Support CI/CD automation strategies for testing and deployment workflows.
• Work in fast-paced environments across multiple platforms and cloud technologies.

Skills

SQL

Data Validation

Agile QA

Analytical thinking

Troubleshooting

Collaboration

Tools

Azure Synapse

ADF

Databricks

SQL Server

Python

PySpark

Rest Assured

TestNG

Cucumber

Jenkins

Bamboo

Azure DevOps

CI/CD

Job description

Indium is seeking an ETL Automation Engineer with 10+ years of experience to lead end-to-end data pipeline testing on Azure platforms and to develop automated QA frameworks. The role requires strong SQL, data validation, and cross-functional collaboration across the SDLC in a fast-paced, multi-cloud environment.

Deep expertise in Azure Synapse, ADF, Databricks, and SQL Server, plus Python, PySpark, and CI/CD tooling is essential.