Principal GCP Data Engineer: Lead Data Solutions

PA Consulting; Bristol; On-site; GBP 90,000 - 120,000; Full time

Benefits offered by this job

Private medical insurance

Interest free seasonal ticket loan

25 days annual leave with option to 5买

Company pension scheme

Annual performance-based bonus

Life and income protection insurance

Tax efficient benefits

Voluntary benefits: dental, critical-—

Job summary

PA Consulting seeks a Principal GCP Data Engineer in Bristol to lead data engineeringDelivery using Google Cloud Platform. You will design robust data pipelines, craft end-to-end solutions and set engineering standards across architecture, scope and deployments.

You will mentor teams, influence client stakeholders and shape data strategy, with a focus on scalable, secure data platforms and modern best practices in an agile environment.

Qualifications

• Experience delivering production-ready data processing solutions on Google Cloud Platform (GCP).
• Experience developing end-to-end solutions with batch and streaming frameworks such as Apache Spark and Apache Beam.
• Expert understanding of relational and non-relational storage, data warehousing and data lakes.
• Expert understanding of data pipeline patterns: event-driven, ETL/ELT, streaming and data visualization.
• Experience translating business requirements into technical specifications and designs.
• Experience with metadata management (Cloud Data Catalog, Collibra) and data governance tools (Dataplex).
• Experience building solutions on GCP using cloud-native principles and patterns.
• Experience in CI/CD pipelines with Git, automated tests and deployments.
• Comfortable working in an Agile team using Scrum or Kanban methodologies.

Responsibilities

• Develop robust data processing jobs using Google Cloud Dataflow, Dataproc and BigQuery.
• Design and deliver automated data pipelines using Cloud Composer.
• Design end-to-end solutions and contribute to architecture discussions beyond data processing.
• Own the development process for your team, establishing robust patterns for architecture, scope, code quality and deployments.
• Shape team behaviour for writing specs, estimating stories, sprint planning and documentation.
• Evolve PA’s data engineering standards and practices to maintain a modern, robust approach.
• Lead and influence technical discussions with client stakeholders to secure buy-in.
• Coach and mentor team members, building expertise across the group.

Skills

BigQuery

Dataflow

Dataproc

Cloud Composer

Apache Spark

Apache Beam

GCP

CI/CD

Agile/Scrum/Kanban

Data governance

Tools

PostgreSQL

MySQL

Oracle

SQL Server

Hadoop

Cloud Data Catalog

Collibra

Dataplex

Kafka

Job description

PA Consulting seeks a Principal GCP Data Engineer in Bristol to lead data engineeringDelivery using Google Cloud Platform. You will design robust data pipelines, craft end-to-end solutions and set engineering standards across architecture, scope and deployments.

You will mentor teams, influence client stakeholders and shape data strategy, with a focus on scalable, secure data platforms and modern best practices in an agile environment.