Principal GCP Data Engineer: Architect Data Pipelines

PA Consulting; West of England; On-site; GBP 110,000 - 150,000; Full time

Benefits offered by this job

Private medical insurance

Season ticket loan

Annual leave 25 days

Pension scheme

Bonus

Life insurance

Tax benefits

Voluntary benefits

Job summary

PA Consulting is seeking a Principal GCP Data Engineer to lead data processing initiatives for clients. You will guide end-to-end delivery and demonstrate technical excellence while mentoring engineers and collaborating across teams.

We value hands-on work with BigQuery, Dataflow, Dataproc, Spark and Beam, and strong data governance. You will shape architecture, standards and practices in an agile environment.

Qualifications

• Experience delivering production-grade data processing solutions on GCP.
• Proficiency with data pipelines, batch and streaming processing.
• Strong understanding of data storage technologies and data lakes.
• Experience with CI/CD, automated tests and deployment.
• Ability to translate business requirements into technical designs.
• Familiarity with metadata management and data governance tools.
• Proactive in defining standards and guiding teams.

Responsibilities

• Develop data processing jobs using BigQuery, Dataflow and Dataproc.
• Design automated data pipelines with Cloud Composer.
• Contribute to architecture discussions beyond data processing.
• Own development processes, enforcing quality & deployment practices.
• Define and evolve PA’s data engineering standards.
• Lead technical discussions with client stakeholders for buy‑in.
• Coach and mentor team members across seniority levels.

Skills

BigQuery

Pub/Sub

Dataflow

Dataproc

Spark

Beam

Cloud Composer

Data governance

CI/CD

Agile/Scrum/Kanban

Education

Experience with data platforms

Tools

GCP

Collibra

Cloud Data Catalog

Dataplex

PostgreSQL

MySQL

Job description

PA Consulting is seeking a Principal GCP Data Engineer to lead data processing initiatives for clients. You will guide end-to-end delivery and demonstrate technical excellence while mentoring engineers and collaborating across teams.

We value hands-on work with BigQuery, Dataflow, Dataproc, Spark and Beam, and strong data governance. You will shape architecture, standards and practices in an agile environment.