Cloud Data Ingestion Architect & Solution Lead

Wpp Media Limited; Sydney; Sur place; AUD 130 000 - 190 000; Plein temps

Avantages offerts par ce poste

Paid parental leave

Discounted health insurance

Résumé du poste

NCS Australia is seeking an experienced Solution Designer / Lead Data Engineer to drive a high-priority enterprise transformation: uplifting, modernizing, and scaling our Data Ingestion framework across cloud platforms.

You will architect scalable, real-time pipelines, author design docs, and guide teams across GCP/AWS/Azure, connecting on‑prem databases, SaaS tools, and streaming services into modern data lakes and warehouses, with governance baked in.

Qualifications

• Experience designing scalable data platforms across major cloud platforms (GCP, AWS, or Azure).
• Proven track record as a Solution Designer, Data Architect, or Lead Data Engineer crafting designs for large-scale data ecosystems.
• Deep understanding of batch, micro-batch, real-time event streaming, CDC, and API-driven ingestion.
• Strong proficiency in SQL, schema design, data partitioning, and data modelling (Star/Snowflake, Data Vault).
• Excellent communication skills to articulate complex data architecture decisions to stakeholders.

Responsabilités

• Architect and lead end-to-end design of a modern, scalable Data Ingestion framework across cloud platforms.
• Author comprehensive SDDs, architectural blueprints, data mapping specs, and reusable ingestion patterns for batch and streaming datasets.
• Provide technical leadership to squads building high-throughput data pipelines across cloud environments (GCP, AWS, Azure).
• Design secure, standardized ingestion interfaces connecting on-prem databases, SaaS tools, APIs, and streaming brokers into data lakes and warehouses.
• Embed data quality checks, data lineage, encryption, and governance (IAM, Data Catalog, DLP) into the ingestion lifecycle.
• Optimize pipeline latency, ensure high availability, and govern multi-cloud compute/storage costs.

Connaissances

Python

Scala

Java

SQL

Data governance

Data architecture

Communication

Outils

Apache Spark

Airflow/Composer

Kafka

dbt

Iceberg/Delta Lake

Terraform

BigQuery

Redshift

Description du poste

NCS Australia is seeking an experienced Solution Designer / Lead Data Engineer to drive a high-priority enterprise transformation: uplifting, modernizing, and scaling our Data Ingestion framework across cloud platforms.

You will architect scalable, real-time pipelines, author design docs, and guide teams across GCP/AWS/Azure, connecting on‑prem databases, SaaS tools, and streaming services into modern data lakes and warehouses, with governance baked in.