Data Platform Engineer I – Pipelines & AI

Cpb; Sydney; Hybrid; AUD 120,000 - 180,000; Full time

Benefits offered by this job

Salary packaging

Parental leave

Udemy access

Well-being allowance

Career development

Job summary

CPB is seeking a Lead Data Engineer in Sydney to design, build and operate reliable data platforms supporting AI, automation and Modern Workplace initiatives. You will translate business requirements into secure, scalable data solutions and collaborate with product, engineering and business teams.

You will work across the data lifecycle, employing Python and SQL with Databricks, Snowflake or Microsoft Fabric, and provide technical guidance while improving engineering practices.

Qualifications

• Hands-on experience delivering production data solutions using Databricks, Snowflake or Microsoft Fabric.
• Strong programming skills in Python and SQL.
• Experience designing, developing and operating data pipelines, including ETL/ELT processes, orchestration and monitoring.
• Understanding of data architecture and modelling techniques, including analytical and dimensional modelling.
• Experience integrating data through APIs and implementing RBAC and data security best practices.

Responsibilities

• Design, build and maintain data pipelines to ingest, transform and deliver data from a range of sources, including APIs.
• Develop solutions using Databricks, Snowflake or Microsoft Fabric, selecting approaches that suit the client’s requirements and existing environment.
• Contribute to data architecture and solution design, including data storage, integration and modelling.
• Develop data models, ontologies and semantic layers for consistent business definitions and analytics.
• Implement pipeline orchestration, scheduling, monitoring and operational support.
• Troubleshoot data and pipeline issues, improving performance, scalability and cost efficiency.
• Apply data quality controls, automated testing and validation.
• Implement RBAC and security best practices for data platforms and integrations.
• Apply DevOps practices to data engineering, including version control and CI/CD.
• Build data visualisations and reports for business users.
• Document solutions and share knowledge for maintainable delivery.

Skills

Databricks

Snowflake

Microsoft Fabric

Python

SQL

CI/CD

RBAC

Tools

PostgreSQL

SQL Server

Google BigQuery

Amazon Redshift

Job description

CPB is seeking a Lead Data Engineer in Sydney to design, build and operate reliable data platforms supporting AI, automation and Modern Workplace initiatives. You will translate business requirements into secure, scalable data solutions and collaborate with product, engineering and business teams.

You will work across the data lifecycle, employing Python and SQL with Databricks, Snowflake or Microsoft Fabric, and provide technical guidance while improving engineering practices.