Senior Data Engineer - Real-Time Data Platform Lead

News Corp; Sydney; Hybrid; AUD 150,000 - 210,000; Full time

Benefits offered by this job

Exclusively ours

Perks & discounts

Health & wellbeing

Time off

Financial wellbeing

Job summary

News Corp Australia is seeking a Senior Data Engineer to design, build, and optimize data platform architecture across multiple platforms including a central data hub and Adobe Experience. You will develop robust pipelines, work with product and marketing teams, and drive digital transformation through scalable, secure data solutions.

You will lead data modeling, implement secure practices (PII masking, RBAC), and explore GenAI-powered automation to accelerate delivery while managing cloud

Qualifications

• 8+ years of experience in Data Engineering, Data Warehousing, and enterprise ETL/ELT architecture.
• Deep AWS cloud and serverless expertise focused on data manipulation.
• Proficiency in Python and Scala/Java, plus SQL/NoSQL databases.
• Experience with distributed data processing: PySpark, Spark, Databricks or Snowflake.
• Ability to translate complex tech into business outcomes for stakeholders.

Responsibilities

• Design, develop, and deploy scalable real-time and batch ELT/ETL pipelines with AWS Glue, MWAA, Kinesis, Flink.
• Lead data modeling and performance tuning across Redshift, RDS, and PostgreSQL.
• Integrate SaaS data platforms, data lakehouses, and third-party ecosystems.
• Leverage GenAI to automate data engineering tasks and testing frameworks.
• Enforce data security, privacy, RBAC, and FinOps across cloud infra.
• Provide technical leadership and mentorship to peers and stakeholders.

Skills

AWS Glue

MWAA

Kinesis

Flink

Data modeling

Redshift

RDS

PostgreSQL

SaaS platforms

Data lakehouses

GenAI

RBAC

Python

Scala/Java

SQL

NoSQL

PySpark

Spark

Databricks

Snowflake

Communication

Adobe Analytics

Google Analytics

CDP

Tools

AWS

Databricks

Snowflake

Job description

News Corp Australia is seeking a Senior Data Engineer to design, build, and optimize data platform architecture across multiple platforms including a central data hub and Adobe Experience. You will develop robust pipelines, work with product and marketing teams, and drive digital transformation through scalable, secure data solutions.

You will lead data modeling, implement secure practices (PII masking, RBAC), and explore GenAI-powered automation to accelerate delivery while managing cloud