Senior Data Engineer: Cloud Data & AI Modernisation

Talent Insights Group; Sydney; Ibrido; AUD 150.000 - 210.000; Tempo pieno

Descrizione del lavoro

Talent Insights Group in Sydney is seeking a Senior Data Engineer to own the curated data pipeline layer in GCP, transforming raw data into scalable pipelines and semantic layers.

You will modernise legacy environments, build modular data products, and support enterprise dashboards, analytics and production ML, through cross‑functional collaboration. This is a hybrid role with an initial 12‑month contract and scope to extend.

Competenze

• 5+ years of commercial Data Engineering or Software Engineering experience.
• Strong Python, SQL and Linux skills.
• Extensive experience with cloud data platforms (GCP BigQuery) or comparable (Snowflake, Databricks).
• Experience with dbt Core and modular data modelling.
• Production workflows with Airflow/Cloud Composer.
• Experience modernising data warehouses and migrations.
• Familiarity with AI tools like Claude Code or Copilot is a plus.

Mansioni

• Architect scalable data pipelines using BigQuery, Airflow, and Vertex AI Pipelines.
• Modernise legacy data foundations into central, governed architectures.
• Build curated data products and semantic layers.
• Apply AI augmentation, testing frameworks, data contracts, and schema drift monitoring.
• Collaborate with platform teams, data scientists, BI analysts, and stakeholders.
• Provide post-deployment support and maintain technical documentation.

Conoscenze

Python

SQL

Linux

Data Modeling

Stakeholder Management

Communication

Strumenti

BigQuery

Airflow / Cloud Composer

Vertex AI Pipelines

dbt Core

Git

Docker

CI/CD

Cloud Platform

Descrizione del lavoro

Talent Insights Group in Sydney is seeking a Senior Data Engineer to own the curated data pipeline layer in GCP, transforming raw data into scalable pipelines and semantic layers.

You will modernise legacy environments, build modular data products, and support enterprise dashboards, analytics and production ML, through cross‑functional collaboration. This is a hybrid role with an initial 12‑month contract and scope to extend.