Security-Cleared Senior Cloud Data Engineer ETL/ELT Sydney

Softtest Pays Pty; Sydney; On-site; AUD 120,000 - 170,000; Full time

Job summary

Softtest Pays Pty in Sydney, NSW, Australia is seeking a Senior Software Engineer to design and implement scalable ETL/ELT pipelines for large data movements and visualisations in a cloud environment.

You will optimise data for fast query performance using distributed engines (Spark) and work with engineering, storage and analytics services within an Agile development team to deliver robust data solutions.

Qualifications

• Experience designing and implementing ETL/ELT pipelines for large data sets.
• Optimise data for query performance in cloud compute engines.
• Collaborate with engineering, storage and analytics teams in cloud environments.
• Experience working in an Agile development team.

Skills

ETL/ELT development

Cloud data engineering

Agile development

Tools

Spark

Azure SQL

Python

R

Job description

Softtest Pays Pty in Sydney, NSW, Australia is seeking a Senior Software Engineer to design and implement scalable ETL/ELT pipelines for large data movements and visualisations in a cloud environment.

You will optimise data for fast query performance using distributed engines (Spark) and work with engineering, storage and analytics services within an Agile development team to deliver robust data solutions.