Senior Data Engineer: Real-Time Pipelines & GenAI

News Corp Australia; Sydney; Hybrid; AUD 180,000 - 260,000; Full time

Benefits offered by this job

Hybrid work environment

Health & wellbeing program

Parental leave and flexible leave

Perks & discounts

Access to News Corp publications

Job summary

News Corp Australia is seeking a Senior Data Engineer to design and optimise enterprise-scale data platform architecture. You will build robust data pipelines across four platforms, including our central data hub and Adobe Experience platforms, ensuring secure, scalable code.

You will lead data modeling, pipeline deployments, and cross-functional collaboration with Product and Marketing teams to enable advanced segmentation and campaigns.

Qualifications

• 8+ years in Data Engineering, Data Warehousing or enterprise ETL/ELT
• Hands-on AWS cloud and serverless data manipulation expertise
• Proficient in Python, Scala/Java, SQL; strong NoSQL skills

Responsibilities

• Design, develop, and deploy real-time and batch ELT/ETL pipelines using AWS Glue, MWAA, Kinesis, Flink
• Lead data modeling and schema design across cloud databases and data warehouses (Redshift, RDS, PostgreSQL)
• Manage SaaS data platforms, data lakehouses, and third-party integrations
• Utilize GenAI/Agentic AI to automate data engineering tasks and testing frameworks
• Enforce data security, privacy (PII masking, RBAC) and manage FinOps costs
• Mentor peers and align with product stakeholders for high-quality delivery

Skills

Python

Scala/Java

SQL

NoSQL

PySpark

Spark

Databricks

Snowflake

AWS Cloud

Data Modeling

Communication

Tools

AWS Glue

MWAA

Kinesis

Flink

Redshift

RDS

PostgreSQL

Job description

News Corp Australia is seeking a Senior Data Engineer to design and optimise enterprise-scale data platform architecture. You will build robust data pipelines across four platforms, including our central data hub and Adobe Experience platforms, ensuring secure, scalable code.

You will lead data modeling, pipeline deployments, and cross-functional collaboration with Product and Marketing teams to enable advanced segmentation and campaigns.