Etl Automation Engineer

Indium; North Lismore; On-site; AUD 120,000 - 180,000; Full time

Job summary

Indium is seeking an ETL Automation Engineer with 10+ years of experience to lead end-to-end data pipeline testing on Azure platforms and to automate testing processes.

You will design automated testing frameworks, validate complex business logic with SQL, monitor pipelines, and support CI/CD for testing and deployment in fast-paced, multi-cloud environments. Collaboration across SDLC is essential.

Qualifications

• End-to-end data pipeline testing on Azure platforms and automation of testing processes.
• Design and implement automated testing frameworks for data and volume testing.
• Validate complex business logic and data transformations using advanced SQL queries.
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery.
• Create and maintain test plans, test data, and QA documentation.
• Support CI/CD automation strategies for testing and deployment workflows.

Responsibilities

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes.
• Monitor pipeline executions across environments and report failures/issues.
• Design and implement automated testing frameworks for data and volume testing.
• Validate complex business logic and data transformations using advanced SQL queries.
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery.
• Create and maintain test plans, test data, and QA documentation.
• Support CI/CD automation strategies for testing and deployment workflows.
• Work in fast-paced environments across multiple platforms and cloud technologies.

Skills

SQL/Data Validation

Azure Synapse

ADF

Databricks

SQL Server

Python

PySpark

Rest Assured

TestNG

Cucumber

OLTP/OLAP databases

CI/CD tools

Jenkins

Bamboo

Azure DevOps

Agile QA methodologies

Automation frameworks

Analytical skills

Troubleshooting

Collaboration

Job description

Job Description

Job Title: ETL Automation Engineer

Experience: 10+ Years

Job Description

• Perform end-to-end Data Pipeline Testing on Azure platforms and automate testing processes
• Monitor pipeline executions across environments and report failures/issues
• Design and implement automated testing frameworks for data and volume testing
• Validate complex business logic and data transformations using advanced SQL queries
• Collaborate with cross-functional teams throughout the SDLC to ensure quality delivery
• Create and maintain test plans, test data, and QA documentation
• Support CI/CD automation strategies for testing and deployment workflows
• Work in fast-paced environments across multiple platforms and cloud technologies

Required Skills

• Strong expertise in SQL and Data Validation
• Experience with Azure Synapse, ADF, Databricks, and SQL Server
• Hands-on experience with Python, PySpark, Rest Assured, TestNG, and Cucumber
• Experience testing Operational, Relational, OLAP databases, and data warehouses
• Knowledge of CI/CD tools like Jenkins, Bamboo, and Azure DevOps
• Strong understanding of Agile QA methodologies and automation frameworks
• Excellent analytical, troubleshooting, and collaboration skills

Preferred Skills

• Exposure to Financial Domain projects
• Azure/AWS Certification is an added advantage