Senior Data Engineer - Lead AI-Driven Data Pipelines

Talent Insights Group; Sydney; On-site; AUD 150,000 - 210,000; Full time

Job summary

Talent Insights Group is seeking a Senior Data Engineer to join a growing data team and lead the development of capabilities around audience building, customer segmentation, and modern data products. You’ll be hands-on while mentoring engineers, collaborating with Product and business stakeholders, and shaping technical direction for new data capabilities in a scale-up, product-led environment.

The role emphasizes pragmatic engineering standards, AI-enabled workflows, and decisions about

Qualifications

• Strong SQL and data modelling skills.
• Experience designing and delivering modern cloud data platforms.
• Strong experience with one or more of: GCP/BigQuery, Snowflake, Databricks, Redshift.
• Strong understanding of data warehousing, modelling and data lifecycle principles.
• Experience designing scalable data pipelines and production data solutions.
• Demonstrated ability to lead technical initiatives and mentor other engineers.
• Strong communication skills and the ability to work closely with Product and business stakeholders.

Responsibilities

• Lead design and delivery of scalable data engineering solutions supporting audience building and segmentation.
• Develop robust data models and transformation pipelines using dbt and modern cloud technologies.
• Work across cloud data platforms to ingest, transform and expose data for downstream products and applications.
• Help define the architecture and technical direction for new data capabilities.
• Work closely with Product, Analytics and Engineering to translate commercial requirements into scalable technical solutions.
• Establish and improve data engineering standards, modelling practices and development patterns.
• Mentor and support mid-level engineers, helping raise engineering capability across the team.
• Lead technical initiatives from discovery through to delivery.
• Contribute to decisions around whether capabilities should be built internally or supported through third‑party products/platforms.
• Help the team develop more AI‑native ways of working, including evaluating how AI and agent‑based approaches can be incorporated into data workflows.
• Validate technical approaches and AI‑generated outputs using strong engineering judgement.
• Help establish pragmatic standards for how emerging technologies are used across the team.

Skills

SQL

Data Modelling

Cloud Data Platforms

GCP/BigQuery

Snowflake

Databricks

Redshift

Mentoring

Stakeholder Communication

Architectural Judgement

Tools

dbt

Job description

Talent Insights Group is seeking a Senior Data Engineer to join a growing data team and lead the development of capabilities around audience building, customer segmentation, and modern data products. You’ll be hands-on while mentoring engineers, collaborating with Product and business stakeholders, and shaping technical direction for new data capabilities in a scale-up, product-led environment.

The role emphasizes pragmatic engineering standards, AI-enabled workflows, and decisions about