GCP Data Engineer: Cloud-Native Pipelines & BigQuery Expert

Queen Square Recruitment; England; On-site; GBP 83,000 - 1,292,000; Full time

Job summary

Queen Square Recruitment is seeking an experienced GCP Data Engineer for a 1-year contract to design and deliver scalable cloud-native data solutions on Google Cloud Platform. You will work on batch and real-time data engineering across data platforms, orchestration and analytics with cross-functional teams.

The role involves delivering data pipelines with Dataflow, Dataproc and Pub/Sub, building BigQuery solutions, and implementing governance and security controls in a global, multi-vendor

Qualifications

• Experience designing batch and streaming data pipelines on GCP.
• Proficient in Python and PySpark for data processing.
• Experience with Dataflow, Dataproc, Pub/Sub and BigQuery.
• Knowledge of IAM, security controls and governance.
• Experience with Terraform and Git/CI-CD in cloud environments.
• Ability to work across global, multi-vendor delivery teams.

Responsibilities

• Design and build batch and streaming data pipelines using GCP services including Dataflow, Dataproc and Pub/Sub.
• Develop scalable and reusable data processing solutions using Python and PySpark.
• Build and manage orchestration workflows using Cloud Composer / Apache Airflow.
• Develop and optimise BigQuery solutions, including partitioning, clustering and performance tuning.
• Work with structured, semi-structured and unstructured data.
• Implement data quality, integrity, lineage and governance across data platforms.
• Implement IAM, security controls and compliance requirements.
• Contribute to technical design, code reviews and solution governance.
• Support data modernisation and cloud migration initiatives.
• Work within global and multi-vendor delivery environments.

Skills

Analytical thinking

Stakeholder communication

Problem solving

Cloud data architecture

Tools

GCP Dataflow

Dataproc

Pub/Sub

BigQuery

Cloud Composer / Airflow

Python

PySpark

SQL

Terraform

Git / CI/CD

Job description

Queen Square Recruitment is seeking an experienced GCP Data Engineer for a 1-year contract to design and deliver scalable cloud-native data solutions on Google Cloud Platform. You will work on batch and real-time data engineering across data platforms, orchestration and analytics with cross-functional teams.

The role involves delivering data pipelines with Dataflow, Dataproc and Pub/Sub, building BigQuery solutions, and implementing governance and security controls in a global, multi-vendor