GCP Data Engineer

83zero Limited; Isleworth; Hybrid; GBP 97,000 - 101,000; Full time

Job summary

83zero Limited is hiring a Data Engineer to build cloud-native data applications on Google Cloud Platform. The role is a 6-month contract, hybrid with 2 days onsite in Isleworth.

You will design and maintain scalable data pipelines, develop ETL processes, and work with Python, Go and BASH, BigQuery, Pub/Sub and Dataflow while embracing IaC with Terraform and Ansible.

Qualifications

• Hands-on Python development with Go and BASH.
• Experience building data pipelines in Google Cloud Platform.
• Familiar with BigQuery, Pub/Sub and Dataflow.
• Experience with Infrastructure as Code (Terraform, Ansible).
• CI/CD and Linux environments experience.

Responsibilities

• Design, develop and maintain scalable data applications and engineering solutions in GCP.
• Build production-grade ETL and data processing pipelines for large data volumes.
• Develop cloud-native apps and services using Python, Go and BASH.
• Automate cloud infrastructure and deployments with Terraform and Ansible.
• Implement and maintain CI/CD pipelines and support production systems.

Skills

Python

Go

BASH

BigQuery

Pub/Sub

Dataflow

Terraform

Ansible

CI/CD

Linux

Job description

Data Engineer - GCP | £525-£550 per day | Inside IR35

6-Month Contract | Hybrid - 2 Days Onsite in Isleworth

83zero are working with a leading media and broadcasting organisation who are looking for an experienced Data Engineer to join their engineering team on an initial 6-month contract.

This is a hands-on engineering role focused on building and supporting cloud-native data applications, services and scalable data pipelines within Google Cloud Platform.

We are looking for someone with a strong software engineering mindset who is comfortable developing production-grade applications, working with large-scale data platforms and automating cloud infrastructure.

What You'll Be Doing

• Designing, developing and maintaining scalable data applications and engineering solutions within GCP.
• Building production-grade ETL and data processing pipelines handling large volumes of data.
• Developing cloud-native applications and services using Python, Go and BASH.
• Working extensively with GCP technologies, including BigQuery, Pub/Sub and Dataflow.
• Building and integrating APIs, services and automated workflows across the data platform.
• Writing reusable, maintainable and well-tested application code.
• Automating cloud infrastructure and deployments using Terraform and Ansible.
• Building and maintaining CI/CD pipelines using tools such as Jenkins, GitLab CI or GoCD.
• Supporting applications and services running within Linux-based environments.
• Troubleshooting performance, reliability and production issues across applications and data pipelines.
• Working closely with engineering and product teams to deliver scalable, reliable solutions into production.

What We're Looking For

• Strong commercial experience as a Data Engineer / Software Engineer / Data Application Engineer.
• Excellent hands-on development experience with Python, ideally alongside Go and BASH.
• Strong experience building applications, services and data pipelines within Google Cloud Platform.
• Hands-on knowledge of BigQuery, Pub/Sub and Dataflow.
• Experience designing and developing scalable ETL / data processing solutions.
• Good understanding of software engineering principles, testing and production-grade development.
• Strong experience with Infrastructure as Code, particularly Terraform and ideally Ansible.
• Experience working with CI/CD and automated deployment pipelines.
• Strong knowledge of Linux environments.
• Comfortable working within a large-scale engineering environment and taking ownership of solutions through development, deployment and production support.
• Able to work 2 days per week onsite in Osterley.