Strategic Ai Design Lead, Marketing Workflows

Wpp Media Limited; Sydney; Sur place; AUD 130 000 - 190 000; Plein temps

Avantages offerts par ce poste

Paid parental leave

Discounted health insurance

Résumé du poste

NCS Australia is seeking an experienced Solution Designer / Lead Data Engineer to drive a high-priority enterprise transformation: uplifting, modernizing, and scaling our Data Ingestion framework across cloud platforms.

You will architect scalable, real-time pipelines, author design docs, and guide teams across GCP/AWS/Azure, connecting on‑prem databases, SaaS tools, and streaming services into modern data lakes and warehouses, with governance baked in.

Qualifications

• Experience designing scalable data platforms across major cloud platforms (GCP, AWS, or Azure).
• Proven track record as a Solution Designer, Data Architect, or Lead Data Engineer crafting designs for large-scale data ecosystems.
• Deep understanding of batch, micro-batch, real-time event streaming, CDC, and API-driven ingestion.
• Strong proficiency in SQL, schema design, data partitioning, and data modelling (Star/Snowflake, Data Vault).
• Excellent communication skills to articulate complex data architecture decisions to stakeholders.

Responsabilités

• Architect and lead end-to-end design of a modern, scalable Data Ingestion framework across cloud platforms.
• Author comprehensive SDDs, architectural blueprints, data mapping specs, and reusable ingestion patterns for batch and streaming datasets.
• Provide technical leadership to squads building high-throughput data pipelines across cloud environments (GCP, AWS, Azure).
• Design secure, standardized ingestion interfaces connecting on-prem databases, SaaS tools, APIs, and streaming brokers into data lakes and warehouses.
• Embed data quality checks, data lineage, encryption, and governance (IAM, Data Catalog, DLP) into the ingestion lifecycle.
• Optimize pipeline latency, ensure high availability, and govern multi-cloud compute/storage costs.

Connaissances

Python

Scala

Java

SQL

Data governance

Data architecture

Communication

Outils

Apache Spark

Airflow/Composer

Kafka

dbt

Iceberg/Delta Lake

Terraform

BigQuery

Redshift

Description du poste

Job Description

We are seeking an experienced Solution Designer / Lead Data Engineer to drive a high-priority enterprise transformation initiative: uplifting, modernizing, and scaling our enterprise Data Ingestion framework across cloud platforms.

What You’ll Be Doing

• Architect and lead the end-to-end design of a modern, scalable, and automated enterprise Data Ingestion framework, transitioning legacy ingestion systems toward real-time, event-driven cloud workflows.
• Author comprehensive Solution Design Documents (SDDs), architectural blueprints, data mapping specifications, and reusable ingestion patterns for both batch and streaming datasets.
• Provide technical leadership and hands‑on guidance to engineering squads building high-throughput data pipelines across major cloud provider environments (GCP, AWS, or Azure).
• Design secure, standardised ingestion interfaces connecting on‑premises databases, enterprise SaaS tools, APIs, and streaming brokers into modern cloud data lakes and enterprise warehouses.
• Embed automated data quality checks, data lineage tracking, enterprise encryption, and governance controls (IAM, Data Catalog, DLP) directly into the ingestion lifecycle.
• Optimize data pipeline latency, ensure high system availability, and govern multi‑cloud compute/storage costs.

Qualifications

• Extensive experience designing and building scalable data platforms across major cloud platforms (GCP, AWS, or Azure) using modern cloud‑native data architectures.
• Proven track record as a Solution Designer, Data Architect, or Lead Data Engineer crafting high‑level and detailed technical designs for large‑scale enterprise data ecosystems.
• Deep understanding of modern ingestion paradigms (batch, micro‑batch, real‑time event streaming, Change Data Capture (CDC), and API‑driven ingestion).
• Strong practical experience with distributed data tools and frameworks (e.g., Apache Spark, Airflow/Composer, Kafka, Pub/Sub, Kinesis, Snowflake, BigQuery, or Redshift).
• Advanced proficiency in SQL, schema design, data partitioning, and data modelling strategies (e.g., Star/Snowflake schemas, Data Vault).
• High proficiency in Python, Scala, or Java, alongside Infrastructure as Code (Terraform) and CI/CD automated deployment pipelines.
• Exceptional communication skills with the ability to articulate complex data architecture decisions to tech leads, product owners, and executive stakeholders.
• Hands‑on experience with dbt, Apache Iceberg/Delta Lake, or enterprise data catalog frameworks.
• Knowledge of regulatory compliance frameworks regarding data privacy and cross‑cloud data movement.

Additional Information

NCS Australia is where you can feel at home, nurturing your talents and skills as we make tomorrow together, one day at a time. Our benefits include paid parental leave, initiatives focused on your well‑being and discounted health insurance. You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance. We are committed to your career development through our Capability Fingerprint, industry and partner training programmes, special interest groups, and an AI‑driven learning platform. No matter where you are in your career, we offer meaningful work and opportunities for growth.

NCS Australia is an equal‑opportunity employer, and we take pride in our commitment to valuing and supporting our people and the communities we serve. We are dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability and age. Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans, Aboriginal and/or Torres Strait Islander community.

We are committed to supporting adjustments throughout the recruitment and selection process, as well as during employment. We actively support and encourage people with disability to apply.

Work rights and background checks: To be eligible for a position with us, applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process, including probity and police checks.