Senior Data Engineer - GCP Data Platforms & Billing Pipelines

Talent Insights Group; Sydney; Hybrid; AUD 148,000 - 185,000; Full time

Benefits offered by this job

Hybrid work schedule

Job summary

Talent Insights Group in Sydney is seeking a Senior Data Engineer to join a newly formed engineering team on a 6‑month contract, with extensions. The role focuses on GCP, BigQuery, dbt and Airflow to improve and replatform data pipelines supporting billing and invoicing.

You will work hands-on with a production billing system, enhancing automation, data quality, observability and performance while collaborating with stakeholders across engineering, product and business.

Qualifications

• 5+ years' experience in Data Engineering.
• Strong commercial experience with GCP.
• Excellent BigQuery and SQL skills.
• Strong hands-on dbt experience.
• Solid Python experience.
• Experience with Airflow / Cloud Composer.
• Experience designing and maintaining batch data pipelines.
• Good understanding of data modelling and transformation.
• Experience with complex data matching and transformation logic.
• Exposure to IaC, Terraform and CI/CD.
• Experience improving or replatforming existing production data systems.
• Strong stakeholder communication skills.
• A pragmatic approach to solving complex business problems.
• Experience with Temporal, APIs, Java/Kotlin or Google Cloud certifications would be advantageous.

Responsibilities

• Enhancing existing billing and invoicing automation pipelines.
• Building and optimising scalable batch data pipelines.
• Reducing manual intervention within the monthly billing process.
• Working across multiple data sources, including MarTech/AdTech, billing systems, Salesforce and other enterprise platforms.
• Designing and maintaining data models and transformation layers using dbt.
• Developing pipelines using Apache Airflow / Cloud Composer.
• Supporting a broader replatforming and optimisation programme within GCP.
• Translating complex business logic and billing requirements into reliable data solutions.
• Improving data quality, observability and pipeline performance.
• Working closely with engineering, product and business stakeholders to understand requirements and deliver practical solutions.

Job description

Talent Insights Group in Sydney is seeking a Senior Data Engineer to join a newly formed engineering team on a 6‑month contract, with extensions. The role focuses on GCP, BigQuery, dbt and Airflow to improve and replatform data pipelines supporting billing and invoicing.

You will work hands-on with a production billing system, enhancing automation, data quality, observability and performance while collaborating with stakeholders across engineering, product and business.