GCP Data Engineer (Google)

NCS Group Australia; City of Melbourne; On-site; AUD 120,000 - 160,000; Full time

Benefits offered by this job

Paid parental leave

Discounted health insurance

Career development programs

AI-driven learning platform

Job summary

NCS Australia is seeking a Data Engineer to design, build and scale massive data pipelines that power critical decisions and analytics. You will architect end‑to‑end data processing using BigQuery, Dataflow, Pub/Sub, and Cloud Composer, driving robust, secure and high‑throughput systems across the organization.

You will translate complex product and data science requirements into scalable solutions, collaborate with cross‑functional teams, and champion DataOps practices to improve data quality

Qualifications

• Experience building scalable data pipelines and data models.
• Strong knowledge of GCP data services and security practices.
• Ability to translate business requirements into scalable solutions.
• Experience with CI/CD for data pipelines and DatOps principles.

Responsibilities

• Design, build and maintain scalable data pipelines (ETL/ELT).
• Optimize data models in BigQuery for performance and cost.
• Collaborate with data scientists, analysts and software engineers.
• Ensure data quality, integrity and security across platforms.
• Monitor production data systems and implement CI/CD practices.

Skills

Data pipelines

CI/CD

Data quality

Collaboration

Security

Education

GCP Professional Data Engineer Certification

Tools

BigQuery

Dataflow

Cloud Composer

Pub/Sub

Kubernetes

Terraform

Python

Job description

At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart. Our team brings this belief to life by partnering with our clients and communities to make tomorrow together.

We are committed to creating an environment that prioritises innovation, collaboration, and purposeful work. Our diverse team is empowered to make a meaningful impact with curiosity, creativity and resilience to shape better outcomes. Join us and accept the challenge of creating a better tomorrow.

At NCS Australia, we believe in doing technology services better. Our commitment to quality, focus on people, and willingness to challenge traditional thinking set us apart. Our team brings this belief to life by partnering with our clients and communities to make tomorrow together.

We are committed to creating an environment that prioritises innovation, collaboration, and purposeful work. Our diverse team is empowered to make a meaningful impact with curiosity, creativity and resilience to shape better outcomes. Join us and accept the challenge of creating a better tomorrow.

Job Description

This role is responsible for building and scaling the massive, reliable data infrastructure that powers critical decisions, product features, and advanced analytics across our organization—impacting billions of users daily. As a Data Engineer, you will be a core architect and builder of our next‑generation data pipelines, transforming raw, high‑volume data into structured, actionable insights.

You will design, construct, implement, and rigorously manage end‑to‑end data processing systems, focusing on robustness, efficiency, security, and high throughput. Your challenge will be to translate complex, ambiguous business requirements from product managers and data scientists into scalable, fault‑tolerant solutions using cutting‑edge Google Cloud Platform (GCP) technologies. This includes deep involvement with services like BigQuery, Dataflow, Cloud Composer, and Pub/Sub.

Your contributions will be instrumental in enabling data‑driven optimization across areas such as product development, machine learning model training, and operational efficiency, making you a vital partner in Google's ongoing innovation. We're looking for an engineer ready to tackle petabyte‑scale data challenges and champion data quality across the enterprise.

Responsibilities

• Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
• Infrastructure Management: Architect and optimise data models within BigQuery for performance and cost efficiency, supporting high‑volume analytical workloads.
• Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
• Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
• Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.

Qualifications

Responsibilities

• Design and Build: Develop, test, and maintain scalable data pipelines (ETL/ELT) using technologies like Dataflow (Apache Beam), Composer (Apache Airflow), and BigQuery.
• Infrastructure Management: Architect and optimise data models within BigQuery for performance and cost efficiency, supporting high‑volume analytical workloads.
• Collaboration: Work closely with Data Scientists, Analysts, and Software Engineers to understand data needs and ensure data quality, integrity, and security across all platforms.
• Operational Excellence: Monitor and troubleshoot production data systems, implementing best practices for continuous integration and deployment (CI/CD) of data pipelines.
• Innovation: Explore and recommend new data technologies and cloud services to enhance data architecture and governance.

Additional Information

• Strong background and experience in Google (GCP) along with a background as a Data Engineer.
• Experience with real‑time streaming data processing using technologies like Pub/Sub and Dataflow Streaming.
• Familiarity with containerisation and orchestration tools (e.g. Docker, Kubernetes).
• Experience with version control systems (e.g. Git).
• Deep understanding of DataOps principles and automated testing for data quality.
• GCP Professional Data Engineer Certification is a plus.

Additional information

• Previous experience in a similar role as a Cloud Engineer developing, implementing or managing secure Google Cloud solutions at an enterprise level
• Previous hands on Google Cloud experience
• Previous experience of working on Federal Government projects
• Previous experience building infrastructure as code with Terraform at an advanced level
• Ability to script in at least one of the following languages: Python, Bash
• Applied knowledge of CI/CD concepts and deployment of platform solutions
• Solutions experience leveraging GCP‑based core services such as Compute Engine, App Engine, Kubernetes Engine, Cloud Storage, BigQuery, Pub/Sub, etc.
• Be well‑versed in networking concepts, including virtual private clouds (VPCs), subnets, load balancing, firewalls, and DNS
• Experience designing secure and scalable network architectures on Google Cloud
• Security‑focused with a deep understanding of cloud security principles, threats, and mitigation techniques
• Hold one more of the following Professional Level Google Cloud certifications: Cloud Architect, Cloud DevOps Engineer, Cloud Developer or other professional-level Google Cloud certifications

Why join us:

NCS Australia is where you can feel at home, nurturing your talents and skills as we make tomorrow together, one day at a time. Our benefits include paid parental leave, initiatives focused on your well‑being and discounted health insurance. You will also enjoy discounts on various products and services and be regularly recognised and rewarded for high performance. We are committed to your career development through our Capability Fingerprint, industry and partner training programmes, special interest groups, and an AI‑driven learning platform. No matter where you are in your career, we offer meaningful work and opportunities for growth.

NCS Australia is an equal‑opportunity employer, and we take pride in our commitment to valuing and supporting our people and the communities we serve. We are dedicated to attracting, retaining and developing our people regardless of gender identity, ethnicity, sexual orientation, disability and age. Applications are encouraged from all sectors of the community and we strongly encourage applications from the Veterans, Aboriginal and/or Torres Strait Islander community.

At NCS Australia, we are committed to supporting adjustments throughout the recruitment and selection process, as well as during employment. We actively support and encourage people with disability to apply.

Work rights and background checks:

To be eligible for a position with us, applicants will need to have valid work rights for Australia and be willing to undergo a comprehensive background checking process, including probity and police checks