Senior GCP Data Engineer - Real-Time Pipelines & DataOps

NCS Group Australia; City of Melbourne; On-site; AUD 100,000 - 130,000; Full time

Benefits offered by this job

Paid parental leave

Discounted health insurance

Career development programs

Job summary

A technology services provider located in Melbourne is seeking a Mid-Senior Data Engineer to develop and manage scalable data infrastructures. The ideal candidate will have a strong background in Google Cloud Platform and experience with data pipeline development. You will be responsible for transforming raw data into actionable insights and collaborating closely with cross-functional teams. This position offers full-time employment with opportunities for professional growth and development.

Qualifications

• Strong background and experience in Google Cloud Platform.
• Previous hands-on Google Cloud experience.
• Ability to script in at least one of the following languages: Python, Bash.

Responsibilities

• Develop, test, and maintain scalable data pipelines using Dataflow and BigQuery.
• Monitor and troubleshoot production data systems.
• Collaborate with Data Scientists and Analysts to ensure data integrity.

Skills

Google Cloud Platform (GCP)

Data pipeline development

Real-time streaming data processing

Containerization (Docker, Kubernetes)

Version control (Git)

DataOps principles

Scripting (Python, Bash)

Education

GCP Professional Data Engineer Certification

Tools

Terraform

BigQuery

Pub/Sub

Job description

A technology services provider located in Melbourne is seeking a Mid-Senior Data Engineer to develop and manage scalable data infrastructures. The ideal candidate will have a strong background in Google Cloud Platform and experience with data pipeline development. You will be responsible for transforming raw data into actionable insights and collaborating closely with cross-functional teams. This position offers full-time employment with opportunities for professional growth and development.