GCP Data Engineer — Build AI-Driven Cloud Data Platforms

Opus Recruitment Solutions; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Four-day working weeks

Extra company days off

Early finish Fridays

Pension and benefits package

Equity opportunities

Rapid career progression

Exposure to AI technologies

Job summary

Opus Recruitment Solutions partners with a fast-growing AI and technology scale-up to hire a GCP Data Engineer who will design and build cloud-native data platforms powering analytics, streaming pipelines and AI-driven solutions.

You'll join an autonomous team working with Kafka, Spark, BigQuery and Kubernetes to shape a scalable data architecture on Google Cloud, collaborating with data scientists and engineers to deliver production-grade outcomes.

Qualifications

• Strong hands-on Google Cloud Platform experience.
• Proven experience building and supporting production data platforms.
• Strong understanding of data architecture and data modelling.
• Experience with distributed data processing technologies.
• Knowledge of Infrastructure as Code and cloud engineering best practices.
• Active SC Clearance or eligibility to obtain SC Clearance.
• Kafka and real-time streaming architectures are a plus.
• Spark, Flink, Iceberg and Trino experience desirable.
• Kubernetes and containerised deployments are welcome.

Responsibilities

• Designing and building scalable cloud-native data pipelines within GCP.
• Developing real-time and event-driven architectures using Kafka and streaming technologies.
• Creating robust data platforms capable of processing complex, high-volume datasets.
• Building data models, lineage frameworks and scalable data services.
• Supporting AI and machine learning teams with trusted data foundations.
• Working with Infrastructure as Code, CI/CD and automated testing practices.
• Collaborating with software engineers, architects and data scientists to deliver production-grade solutions.

Skills

Google Cloud Platform

Data platforms

Data architecture

Data modelling

Distributed data processing

Infrastructure as Code

CI/CD

Automated testing

SC Clearance

Kafka

Spark

Kubernetes

Tools

Terraform

Job description

Opus Recruitment Solutions partners with a fast-growing AI and technology scale-up to hire a GCP Data Engineer who will design and build cloud-native data platforms powering analytics, streaming pipelines and AI-driven solutions.

You'll join an autonomous team working with Kafka, Spark, BigQuery and Kubernetes to shape a scalable data architecture on Google Cloud, collaborating with data scientists and engineers to deliver production-grade outcomes.