Data Engineer

Opus Recruitment Solutions

Newcastle upon Tyne

On-site

GBP 55,000 - 75,000

Full time

2 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Opus Recruitment Solutions is seeking an experienced data engineer in Newcastle upon Tyne for a 12‑month FTC with pathway to permanent. You will build and optimise data pipelines using Java or Python, develop real-time streaming and batch data solutions, and work with Kafka, Flink or Spark alongside AWS services (Kinesis, MSK, Lambda, Glue).

You will implement governance, lineage, security, and quality controls, and support CI/CD with Azure DevOps, GitHub Actions or Jenkins, using Terraform and

Qualifications

  • Experience building and optimising data pipelines.
  • Real-time streaming & batch data processing.
  • Exposure to Kafka, Flink or Spark.
  • Develop AWS-based data solutions (Kinesis, MSK, Lambda, Glue).
  • Implement data governance, lineage, security & quality controls.

Responsibilities

  • Build and optimise data pipelines using Java or Python.
  • Develop real-time streaming and batch pipelines.
  • Work with Kafka, Flink or Spark (Kafka/Flink preferred).
  • Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
  • Implement governance, lineage, security and quality controls.
  • Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
  • Use Terraform and IaC practices.
  • Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
  • Collaborate with analytics, AI/ML, product and engineering teams.

Skills

Data pipeline design
Cloud data platforms
CI/CD practices
Team collaboration

Tools

Kafka
Flink
Spark
Kinesis
MSK
Lambda
Glue
Terraform
Docker
Kubernetes
AWS EKS

Job description

Contract: 12-month FTC with pathway to permanent

Right to work in UK

ROLE OVERVIEW:
  • Build and optimise data pipelines using Java (preferred) or Python.
  • Develop real-time streaming and batch data pipelines.
  • Work with Kafka, Flink or Spark, with Kafka/Flink preferred.
  • Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
  • Implement data governance, lineage, security and quality controls.
  • Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
  • Use Terraform and Infrastructure as Code practices.
  • Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
  • Collaborate with analytics, AI/ML, product and engineering teams.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer - Senior Analyst
Data Engineer - Senior Analyst

Opus RS • Newcastle upon Tyne

On-site
GBP 50,000 - 75,000
Data Engineer – Real-Time Pipelines (12m FTC, UK)
Data Engineer – Real-Time Pipelines (12m FTC, UK)

Opus Recruitment Solutions • Newcastle upon Tyne

On-site
GBP 55,000 - 75,000
Data Engineer
Data Engineer

Talent • Greater London

Hybrid
GBP 90,000 - 120,000
Data Engineer
Data Engineer

Nova Stela Ltd • Greater London

Hybrid
GBP 90,000 - 130,000
Data Engineer
Data Engineer

Mackin Talent • Greater London

Hybrid
GBP 73,000 - 106,000
Laptop provided
Phone provided
25 days annual leave (pro-rata)
Data Engineer (contract)
Data Engineer (contract)

Modular Data • United Kingdom

Remote
GBP 101,000 - 166,000
Outside IR35 contract
Fully remote (UK-based)
Meaningful public sector projects
+1
Data Engineer
Data Engineer

G Digital • Greater London

Hybrid
GBP 36,000 - 60,000
Employer pension 5% match
Training budget
Hybrid work model
Data Engineer
Data Engineer

Square One Resources • Glasgow

Hybrid
GBP 57,453 - 75,386
Data Engineer
Data Engineer

Modular Data • United Kingdom

Remote
GBP 70,000 - 110,000
Fully remote (UK-based)
Data Engineer
Data Engineer

TEKsystems • Greater London

Remote
GBP 70,000 - 90,000