Data Engineer

PRA; Sydney; Hybrid; AUD 120,000 - 240,000; Full time

Benefits offered by this job

AWS certification support

Databricks certification support

Hybrid in Sydney

Job summary

PRA has been engaged to build out three engineering tracks across the financial services sector for a client in Sydney. Hiring at three levels—Senior Data Engineer, Data Engineering Lead and Senior Data Engineering Lead—to build the governed data platforms that analytics, ML and generative AI rely on.

You will build and optimise batch and streaming pipelines with SQL, Python and Spark, deliver data platforms on AWS or Databricks, model data for real query patterns across warehouse and lakehouse,

Qualifications

• 3–6 years for Senior Data Engineer role.

Responsibilities

• Build and optimise batch and streaming pipelines and ETL/ELT frameworks using SQL, Python and Spark.
• Deliver data platforms on AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation) and/or Databricks (Unity Catalog, Delta Lake).
• Model data for real query patterns across warehouse and lakehouse, including Iceberg/open table formats.
• Implement data quality, lineage, access control and FinOps with IaC and CI/CD.
• Lead workstreams and grow a team at Lead level and above; own data architecture and engage with stakeholders.

Skills

SQL

Python

Spark

AWS

Databricks

Leadership

Tools

AWS

Databricks

Kafka

Flink

Airflow

dbt

Lake Formation

Job description

PRA has been engaged to build out three engineering tracks across the financial services sector for a client in Sydney.

Hiring at three levels - Senior Data Engineer, Data Engineering Lead and Senior Data Engineering Lead, You'll build the governed data platforms that analytics, machine learning and generative AI are built on.

The role

• Build and optimise batch and streaming pipelines and ETL/ELT frameworks with SQL, Python and Spark
• Deliver data platforms on AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation) and/or Databricks (Unity Catalog, Delta Lake)
• Model data for real query patterns across warehouse and lakehouse, including open table formats such as Iceberg
• Build data quality, lineage, access control and FinOps into the platform, with IaC and CI/CD throughout
• At Lead level and above: lead a workstream and grow a team. Senior Leads own the data architecture across a programme and the commercial conversation with stakeholders

PRA has been engaged to build out three engineering tracks across the financial services sector for a client in Sydney.

Hiring at three levels - Senior Data Engineer, Data Engineering Lead and Senior Data Engineering Lead, You'll build the governed data platforms that analytics, machine learning and generative AI are built on.

The role

• Build and optimise batch and streaming pipelines and ETL/ELT frameworks with SQL, Python and Spark
• Deliver data platforms on AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation) and/or Databricks (Unity Catalog, Delta Lake)
• Model data for real query patterns across warehouse and lakehouse, including open table formats such as Iceberg
• Build data quality, lineage, access control and FinOps into the platform, with IaC and CI/CD throughout
• At Lead level and above: lead a workstream and grow a team. Senior Leads own the data architecture across a programme and the commercial conversation with stakeholders

What you'll bring

• Senior Data Engineer: 3-6 years.
• Lead: 6-10 years.
• Senior Lead: 10-15 years in data engineering, data architecture or technical leadership
• Hands-on AWS and/or Databricks data platform experience, with strong SQL, Python and Spark
• Pipelines you've taken into production and kept running
• At Lead level and above: a track record leading teams and delivering complex data platforms end to end, ideally including time in consulting or professional services
• Financial services or regulated industry experience is preferred

It's a bonus if you've worked with Kafka or Flink, Airflow, dbt, or Lake Formation or DataZone governance, built RAG retrieval layers, or hold AWS, Databricks, dbt or Snowflake certifications.

Culture

• A collaborative data and AI engineering community that shares what works
• Mentoring and coaching at every level
• Hybrid in Sydney, with time on site with the team at agreed intervals

What's on offer

• $120k-$240k package, depending on level
• Permanent, or contract at $800-$1,200 per day
• Support to gain AWS, Databricks and other certifications
• A fast process: CVs reviewed within 48 hours and no take-home or live coding test.