Lead GCP Data Engineer - Data Pipelines and Architecture

Astro Studios, Inc.; Bristol; Vor Ort; GBP 90.000 - 130.000; Vollzeit

Benefits dieser Stelle

Private medical insurance

Season ticket loan

25 days annual leave

Pension scheme

Annual bonus

Life and income protection

Tax benefits

Voluntary benefits

Zusammenfassung

PA Consulting is hiring a Principal GCP Data Engineer in Bristol to lead data engineering efforts for complex client programmes. You will own end-to-end data solutions, guide architecture, and drive best practices across teams with a focus on production-grade pipelines and cloud-native patterns.

You will mentor teammates, influence client stakeholders, and contribute to design discussions beyond data processing, shaping the overall data strategy for large-scale engagements.

Qualifikationen

• Experience delivering and deploying production-ready data processing solutions using BigQuery, Pub/Sub, Dataflow and Dataproc.
• End-to-end solutions with batch and streaming via Spark and Beam.
• Expert understanding of relational and non-relational data stores and data warehousing/data lakes.
• Data pipeline patterns: ETL/ELT, event-driven architectures, stream processing.
• Translate business requirements into technical specifications and designs.
• Experience with metadata management products (Data Catalog, Collibra) and Data Governance.
• Developing solutions on GCP with cloud-native principles and patterns.
• Data quality alerts and quarantine solutions for trusted downstream datasets.
• CI/CD pipelines with git, automated tests and deployments.
• Agile teams using Scrum or Kanban.

Aufgaben

• Develop robust data processing jobs using Google Cloud tools (Dataflow, Dataproc, BigQuery).
• Design and deliver automated data pipelines with Cloud Composer.
• Contribute to end-to-end architecture discussions beyond data processing.
• Own development process for the team, with robust patterns for architecture, scope, quality and deployments.
• Define and evolve PA’s data engineering standards and practices.
• Lead technical discussions with client stakeholders to gain buy-in.
• Coach and mentor team members across seniority levels.

Kenntnisse

BigQuery

Pub/Sub

Dataflow

Dataproc

Apache Spark

Apache Beam

Data warehousing

Data lakes

Event-driven architectures

ETL/ELT

Cloud Data Catalog

Collibra

GCP

CI/CD

Git

Agile (Scrum/Kanban)

Kafka

PostgreSQL

MySQL

Oracle

SQL Server

Dataplex

Tools

Cloud Composer

Kafka

PostgreSQL

MySQL

Oracle

SQL Server

Dataplex

Jobbeschreibung

PA Consulting is hiring a Principal GCP Data Engineer in Bristol to lead data engineering efforts for complex client programmes. You will own end-to-end data solutions, guide architecture, and drive best practices across teams with a focus on production-grade pipelines and cloud-native patterns.

You will mentor teammates, influence client stakeholders, and contribute to design discussions beyond data processing, shaping the overall data strategy for large-scale engagements.