GCP Data Engineer: Scalable Pipelines & Reliability

XPT Software Australia; Sydney; On-site; AUD 120,000 - 160,000; Full time

Job summary

XPT Software Australia is seeking a data engineer to design, build and optimise batch and streaming data pipelines. You will ensure resilience, performance and cost efficiency while implementing monitoring, data quality checks, and automated recovery processes.

You will work with Data Architects, Analysts and business stakeholders to deliver fit-for-purpose solutions, contribute to ingestion frameworks, transformations and data models, and strengthen CI/CD pipelines for automated testing and

Qualifications

• 2–4 years in a data engineering or closely related role.
• Production-ready pipelines delivered end-to-end.
• Experience with batch and streaming ETL/ELT patterns.
• Familiarity with cloud platforms.
• Ability to work with stakeholders and explain complex concepts.

Responsibilities

• Design, build, and optimise batch and streaming data pipelines using approved frameworks and tooling.
• Ensure pipelines are resilient, performant, and cost optimised.
• Implement monitoring, alerting, and automated recovery processes.
• Apply data quality checks and reconciliation processes to ensure accuracy and completeness.
• Maintain metadata, lineage, and documentation to support governance requirements.
• Adhere to RBAC, data privacy, and security standards.
• Contribute to ingestion frameworks, transformation layers, and data models.
• Implement and maintain CI/CD pipelines for automated testing and deployment.
• Optimise data storage and retrieval strategies to meet performance needs.
• Work with Technical Leads, Data Architects, Analysts, and stakeholders to deliver fit-for-purpose solutions.
• Participate in code reviews and knowledge-sharing sessions to improve team capability.

Skills

SQL

Programming skills

ETL/ELT pipelines

Cloud platforms

Data modeling

Data orchestration tools

CI/CD pipelines

Version control

Data quality

Code reviews

Communication

Independent worker

Stakeholder collaboration

Troubleshooting

Job description

XPT Software Australia is seeking a data engineer to design, build and optimise batch and streaming data pipelines. You will ensure resilience, performance and cost efficiency while implementing monitoring, data quality checks, and automated recovery processes.

You will work with Data Architects, Analysts and business stakeholders to deliver fit-for-purpose solutions, contribute to ingestion frameworks, transformations and data models, and strengthen CI/CD pipelines for automated testing and