Senior Data Engineer / Lead, Data Platform Architect (AWS)

PRA; Sydney; Hybrid; AUD 120,000 - 240,000; Full time

Benefits offered by this job

AWS certification support

Databricks certification support

Hybrid in Sydney

Job summary

PRA has been engaged to build out three engineering tracks across the financial services sector for a client in Sydney. Hiring at three levels—Senior Data Engineer, Data Engineering Lead and Senior Data Engineering Lead—to build the governed data platforms that analytics, ML and generative AI rely on.

You will build and optimise batch and streaming pipelines with SQL, Python and Spark, deliver data platforms on AWS or Databricks, model data for real query patterns across warehouse and lakehouse,

Qualifications

• 3–6 years for Senior Data Engineer role.

Responsibilities

• Build and optimise batch and streaming pipelines and ETL/ELT frameworks using SQL, Python and Spark.
• Deliver data platforms on AWS (Glue, Redshift, Athena, MSK, MWAA, Lake Formation) and/or Databricks (Unity Catalog, Delta Lake).
• Model data for real query patterns across warehouse and lakehouse, including Iceberg/open table formats.
• Implement data quality, lineage, access control and FinOps with IaC and CI/CD.
• Lead workstreams and grow a team at Lead level and above; own data architecture and engage with stakeholders.

Skills

SQL

Python

Spark

AWS

Databricks

Leadership

Tools

AWS

Databricks

Kafka

Flink

Airflow

dbt

Lake Formation

Job description

PRA has been engaged to build out three engineering tracks across the financial services sector for a client in Sydney. Hiring at three levels—Senior Data Engineer, Data Engineering Lead and Senior Data Engineering Lead—to build the governed data platforms that analytics, ML and generative AI rely on.

You will build and optimise batch and streaming pipelines with SQL, Python and Spark, deliver data platforms on AWS or Databricks, model data for real query patterns across warehouse and lakehouse,