Etl Automation Engineer

Indium; Greater Bendigo; On-site; AUD 140,000 - 190,000; Full time

Job summary

Indium is seeking an ETL Automation Engineer with 10+ years of experience to lead end-to-end data pipeline testing on Azure. The role requires designing automated frameworks, validating complex data transformations with SQL, and ensuring quality across SDLC teams.

You will monitor pipelines, collaborate with cross-functional teams, and support CI/CD for testing and deployment in fast-paced cloud environments. Strong SQL, Python, and Azure skills are essential.

Qualifications

• 10+ years experience in ETL testing and data validation roles.
• Strong knowledge of Azure data services and SQL-based testing.
• Familiarity with CI/CD and Agile QA processes.
• Ability to design and implement automated testing frameworks.

Responsibilities

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes
• Monitor pipeline executions across environments and report failures/issues
• Design and implement automated testing frameworks for data and volume testing
• Validate complex business logic and data transformations using advanced SQL queries
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery
• Create and maintain test plans, test data, and QA documentation
• Support CI/CD automation strategies for testing and deployment workflows
• Work in fast-paced environments across multiple platforms and cloud technologies

Skills

SQL & Data Validation

Agile QA methodologies

Analytical skills

Troubleshooting & collaboration

Tools

Azure Synapse

Azure Data Factory

Databricks

SQL Server

Python

PySpark

Rest Assured

TestNG

Cucumber

Jenkins

Azure DevOps

Bamboo

OLAP & Data Warehousing

Job description

Job Description

Job Title: ETL Automation Engineer

Experience: 10+ Years

Job Description

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes
• Monitor pipeline executions across environments and report failures/issues
• Design and implement automated testing frameworks for data and volume testing
• Validate complex business logic and data transformations using advanced SQL queries
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery
• Create and maintain test plans, test data, and QA documentation
• Support CI/CD automation strategies for testing and deployment workflows
• Work in fast-paced environments across multiple platforms and cloud technologies

Required Skills

• Strong expertise in SQL and Data Validation
• Experience with Azure Synapse, ADF, Databricks, and SQL Server
• Hands-on experience with Python, PySpark, Rest Assured, TestNG, and Cucumber
• Experience testing Operational, Relational, OLAP databases, and data warehouses
• Knowledge of CI/CD tools like Jenkins, Bamboo, and Azure DevOps
• Strong understanding of Agile QA methodologies and automation frameworks
• Excellent analytical, troubleshooting, and collaboration skills

Preferred Skills

• Exposure to Financial Domain projects
• Azure/AWS Certification is an added advantage