Data Engineer

Opus Recruitment Solutions; Greater London; On-site; GBP 90,000 - 130,000; Full time

Benefits offered by this job

Four-day working weeks

Extra company days off

Early finish Fridays

Pension and benefits package

Equity opportunities

Rapid career progression

Exposure to AI technologies

Job summary

Opus Recruitment Solutions partners with a fast-growing AI and technology scale-up to hire a GCP Data Engineer who will design and build cloud-native data platforms powering analytics, streaming pipelines and AI-driven solutions.

You'll join an autonomous team working with Kafka, Spark, BigQuery and Kubernetes to shape a scalable data architecture on Google Cloud, collaborating with data scientists and engineers to deliver production-grade outcomes.

Qualifications

• Strong hands-on Google Cloud Platform experience.
• Proven experience building and supporting production data platforms.
• Strong understanding of data architecture and data modelling.
• Experience with distributed data processing technologies.
• Knowledge of Infrastructure as Code and cloud engineering best practices.
• Active SC Clearance or eligibility to obtain SC Clearance.
• Kafka and real-time streaming architectures are a plus.
• Spark, Flink, Iceberg and Trino experience desirable.
• Kubernetes and containerised deployments are welcome.

Responsibilities

• Designing and building scalable cloud-native data pipelines within GCP.
• Developing real-time and event-driven architectures using Kafka and streaming technologies.
• Creating robust data platforms capable of processing complex, high-volume datasets.
• Building data models, lineage frameworks and scalable data services.
• Supporting AI and machine learning teams with trusted data foundations.
• Working with Infrastructure as Code, CI/CD and automated testing practices.
• Collaborating with software engineers, architects and data scientists to deliver production-grade solutions.

Skills

Google Cloud Platform

Data platforms

Data architecture

Data modelling

Distributed data processing

Infrastructure as Code

CI/CD

Automated testing

SC Clearance

Kafka

Spark

Kubernetes

Tools

Terraform

Job description

Are you a GCP Data Engineer looking to work on cutting-edge AI and data platforms that solve genuinely complex problems?

We're partnering with a fast-growing AI and technology scale-up that is transforming how organisations manage, process and derive value from large-scale data. Due to continued growth, they are looking to hire a talented GCP Data Engineer to help build and scale cloud-native data platforms that power advanced analytics, streaming pipelines and AI-driven solutions.

As a GCP Data Engineer, you'll join a highly autonomous engineering team responsible for designing and delivering modern data architectures within Google Cloud Platform. You'll work with real-time data, distributed systems and large-scale cloud infrastructure, helping shape a platform from the ground up.

This opportunity is ideal for a GCP Data Engineer who enjoys solving challenging technical problems, influencing architecture decisions and working with modern technologies such as Kafka, Spark, BigQuery and Kubernetes.

What You'll Be Doing

• Designing and building scalable cloud-native data pipelines within GCP
• Developing real-time and event-driven architectures using Kafka and streaming technologies
• Creating robust data platforms capable of processing complex, high-volume datasets
• Building data models, lineage frameworks and scalable data services
• Supporting AI and machine learning teams with trusted data foundations
• Working with modern engineering practices including Infrastructure as Code, CI/CD and automated testing
• Collaborating with software engineers, architects and data scientists to deliver production-grade solutions

What We're Looking For

The successful GCP Data Engineer will have:

• Strong hands-on Google Cloud Platform experience
• Proven experience building and supporting production data platforms
• Strong understanding of data architecture and data modelling
• Experience with distributed data processing technologies
• Knowledge of Infrastructure as Code and cloud engineering best practices
• Active SC Clearance or eligibility to obtain SC Clearance

Highly Desirable Experience

• Kafka and real-time streaming architectures
• Graph databases or knowledge graph technologies
• Entity resolution or data fusion projects
• Spark, Flink, Iceberg and Trino
• Kubernetes and containerised deployments
• AI and machine learning data platforms

Why Apply?

This is an opportunity for a GCP Data Engineer to join one of the most exciting technology businesses in the market, working on greenfield projects that sit at the intersection of cloud, data engineering and AI. You'll have significant ownership, access to modern technologies and the chance to work on highly impactful programmes.

• Four-day working weeks throughout July, August and December
• Additional company days off throughout the year
• Early finish every Friday
• Competitive pension and benefits package
• Equity opportunities
• Rapid career progression
• Exposure to cutting-edge AI technologies and large-scale cloud platforms