Senior Data Engineer

Talent Insights Group; Sydney; Hybrid; AUD 148,000 - 185,000; Full time

Benefits offered by this job

Hybrid work schedule

Job summary

Talent Insights Group in Sydney is seeking a Senior Data Engineer to join a newly formed engineering team on a 6‑month contract, with extensions. The role focuses on GCP, BigQuery, dbt and Airflow to improve and replatform data pipelines supporting billing and invoicing.

You will work hands-on with a production billing system, enhancing automation, data quality, observability and performance while collaborating with stakeholders across engineering, product and business.

Qualifications

• 5+ years' experience in Data Engineering.
• Strong commercial experience with GCP.
• Excellent BigQuery and SQL skills.
• Strong hands-on dbt experience.
• Solid Python experience.
• Experience with Airflow / Cloud Composer.
• Experience designing and maintaining batch data pipelines.
• Good understanding of data modelling and transformation.
• Experience with complex data matching and transformation logic.
• Exposure to IaC, Terraform and CI/CD.
• Experience improving or replatforming existing production data systems.
• Strong stakeholder communication skills.
• A pragmatic approach to solving complex business problems.
• Experience with Temporal, APIs, Java/Kotlin or Google Cloud certifications would be advantageous.

Responsibilities

• Enhancing existing billing and invoicing automation pipelines.
• Building and optimising scalable batch data pipelines.
• Reducing manual intervention within the monthly billing process.
• Working across multiple data sources, including MarTech/AdTech, billing systems, Salesforce and other enterprise platforms.
• Designing and maintaining data models and transformation layers using dbt.
• Developing pipelines using Apache Airflow / Cloud Composer.
• Supporting a broader replatforming and optimisation programme within GCP.
• Translating complex business logic and billing requirements into reliable data solutions.
• Improving data quality, observability and pipeline performance.
• Working closely with engineering, product and business stakeholders to understand requirements and deliver practical solutions.

Job description

Senior Data Engineer | GCP & Data Platforms | 6 Month Contract with extensions
$800-1000 a day including super

I'm working with a high-growth, data-led organisation that is investing in its data and engineering capability and looking for a Senior Data Engineer to join a newly formed engineering team.

This is a hands‑on role with a strong focus on GCP, BigQuery, dbt and Airflow, working on a business‑critical billing and invoicing platform.

The interesting part? You won’t be starting from scratch. There is already a billing system in production, and your role will be to take what has been built, improve it, automate more of the process and help replatform the underlying data pipelines.

What you’ll be working on

The organisation processes large volumes of data from multiple sources to support its billing and invoicing operations.

• Enhancing existing billing and invoicing automation pipelines
• Building and optimising scalable batch data pipelines
• Reducing manual intervention within the monthly billing process
• Working across multiple data sources, including MarTech/AdTech, billing systems, Salesforce and other enterprise platforms
• Designing and maintaining data models and transformation layers using dbt
• Developing pipelines using Apache Airflow / Cloud Composer
• Supporting a broader replatforming and optimisation programme within GCP
• Translating complex business logic and billing requirements into reliable data solutions
• Improving data quality, observability and pipeline performance
• Working closely with engineering, product and business stakeholders to understand requirements and deliver practical solutions

The billing process covers both prepaid and postpaid models, with data needing to be curated to increasingly detailed business requirements.

The technology

This is a particularly strong opportunity for someone who enjoys working in the modern GCP data stack.

Core:

• GCP
• BigQuery
• dbt
• SQL
• Python
• Apache Airflow / Cloud Composer

Also relevant:

• Terraform / IaC
• Docker
• Kubernetes
• CI/CD
• Pub/Sub
• Cloud SQL
• Salesforce
• API integrations

Experience across the full GCP ecosystem is highly desirable, but BigQuery + dbt + Airflow/Cloud Composer are particularly important.

The team

You’ll be joining a newly established engineering team, working alongside Data and Software Engineers and supported by an existing operations/support function.

The wider engineering environment includes a Staff Engineer, with the initial team expected to include Data Engineering and Software Engineering capability.

This role will suit someone who is comfortable operating in an environment where there is already a production platform, but plenty of opportunity to improve, optimise and evolve it.

What we're looking for

You’ll ideally have:

• 5+ years' experience in Data Engineering
• Strong commercial experience with GCP
• Excellent BigQuery and SQL skills
• Strong hands‑on dbt experience
• Solid Python experience
• Experience with Airflow / Cloud Composer
• Experience designing and maintaining batch data pipelines
• A good understanding of data modelling and transformation
• Experience working with complex data matching and transformation logic
• Exposure to IaC, Terraform and CI/CD
• Experience improving or replatforming existing production data systems
• Strong stakeholder communication skills
• A pragmatic approach to solving complex business problems

Experience with Temporal, APIs, Java/Kotlin or Google Cloud certifications would be advantageous, but isn't essential.

The role is suited to someone who enjoys a mix of hands‑on engineering, problem solving and working with the business to turn complex requirements into scalable solutions. The original brief also highlights the importance of being comfortable with both greenfield builds and continuously improving existing production systems.

The details

Sydney – hybrid, 2 days in the office

6 month contract

Interview process

Technical interview

Behavioural interview