Senior Software Engineer

Softtest Pays Pty; Sydney; On-site; AUD 120,000 - 170,000; Full time

Job summary

Softtest Pays Pty in Sydney, NSW, Australia is seeking a Senior Software Engineer to design and implement scalable ETL/ELT pipelines for large data movements and visualisations in a cloud environment.

You will optimise data for fast query performance using distributed engines (Spark) and work with engineering, storage and analytics services within an Agile development team to deliver robust data solutions.

Qualifications

• Experience designing and implementing ETL/ELT pipelines for large data sets.
• Optimise data for query performance in cloud compute engines.
• Collaborate with engineering, storage and analytics teams in cloud environments.
• Experience working in an Agile development team.

Skills

ETL/ELT development

Cloud data engineering

Agile development

Tools

Spark

Azure SQL

Python

R

Job description

Australian Citizens residing in Australia only respond. must have baseline clearance.

1. Demonstrated experience developing ETL/ELT processes for complex and/or large data movement, transformation and/or visualisations, particularly in a cloud environment.

2. Experience preparing data optimised for query performance in cloud computed engines. E.g. Distributed computing engines (Spark) Azure SQL Python R

3. Experience working with Engineering, Storage and Analytics services in cloud infrastructure.4. Experience working collaboratively in an agile development team

Required Skills:

Create a job alert for this search

Senior Software Engineer Sydney, NSW, AU