Etl Automation Engineer

Indium; Albury City; On-site; AUD 130,000 - 170,000; Full time

Job summary

Indium is seeking an ETL Automation Engineer with 10+ years of experience to lead end-to-end data pipeline testing on Azure platforms and to develop automated QA frameworks. The role requires strong SQL, data validation, and cross-functional collaboration across the SDLC in a fast-paced, multi-cloud environment.

Deep expertise in Azure Synapse, ADF, Databricks, and SQL Server, plus Python, PySpark, and CI/CD tooling is essential.

Qualifications

• 10+ years of experience in ETL automation and QA.

Responsibilities

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes.
• Monitor pipeline executions across environments and report failures/issues.
• Design and implement automated testing frameworks for data and volume testing.
• Validate complex business logic and data transformations using advanced SQL queries.
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery.
• Create and maintain test plans, test data, and QA documentation.
• Support CI/CD automation strategies for testing and deployment workflows.
• Work in fast-paced environments across multiple platforms and cloud technologies.

Skills

SQL

Data Validation

Agile QA

Analytical thinking

Troubleshooting

Collaboration

Tools

Azure Synapse

ADF

Databricks

SQL Server

Python

PySpark

Rest Assured

TestNG

Cucumber

Jenkins

Bamboo

Azure DevOps

CI/CD

Job description

Job Description

Job Title: ETL Automation Engineer

Experience: 10+ Years

Job Description

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes
• Monitor pipeline executions across environments and report failures/issues
• Design and implement automated testing frameworks for data and volume testing
• Validate complex business logic and data transformations using advanced SQL queries
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery
• Create and maintain test plans, test data, and QA documentation
• Support CI/CD automation strategies for testing and deployment workflows
• Work in fast-paced environments across multiple platforms and cloud technologies

Required Skills

• Strong expertise in SQL and Data Validation
• Experience with Azure Synapse, ADF, Databricks, and SQL Server
• Hands-on experience with Python, PySpark, Rest Assured, TestNG, and Cucumber
• Experience testing Operational, Relational, OLAP databases, and data warehouses
• Knowledge of CI/CD tools like Jenkins, Bamboo, and Azure DevOps
• Strong understanding of Agile QA methodologies and automation frameworks
• Excellent analytical, troubleshooting, and collaboration skills

Preferred Skills

• Exposure to Financial Domain projects
• Azure/AWS Certification is an added advantage