Data Engineer – Real-Time Pipelines (12m FTC, UK)

Opus Recruitment Solutions

Newcastle upon Tyne

On-site

GBP 55,000 - 75,000

Full time

2 days ago
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Opus Recruitment Solutions is seeking an experienced data engineer in Newcastle upon Tyne for a 12‑month FTC with pathway to permanent. You will build and optimise data pipelines using Java or Python, develop real-time streaming and batch data solutions, and work with Kafka, Flink or Spark alongside AWS services (Kinesis, MSK, Lambda, Glue).

You will implement governance, lineage, security, and quality controls, and support CI/CD with Azure DevOps, GitHub Actions or Jenkins, using Terraform and

Qualifications

  • Experience building and optimising data pipelines.
  • Real-time streaming & batch data processing.
  • Exposure to Kafka, Flink or Spark.
  • Develop AWS-based data solutions (Kinesis, MSK, Lambda, Glue).
  • Implement data governance, lineage, security & quality controls.

Responsibilities

  • Build and optimise data pipelines using Java or Python.
  • Develop real-time streaming and batch pipelines.
  • Work with Kafka, Flink or Spark (Kafka/Flink preferred).
  • Develop AWS-based data solutions using Kinesis, MSK, Lambda and Glue.
  • Implement governance, lineage, security and quality controls.
  • Support CI/CD using Azure DevOps, GitHub Actions or Jenkins.
  • Use Terraform and IaC practices.
  • Deploy containerised workloads using Docker, Kubernetes and AWS EKS.
  • Collaborate with analytics, AI/ML, product and engineering teams.

Skills

Data pipeline design
Cloud data platforms
CI/CD practices
Team collaboration

Tools

Kafka
Flink
Spark
Kinesis
MSK
Lambda
Glue
Terraform
Docker
Kubernetes
AWS EKS

Job description

Opus Recruitment Solutions is seeking an experienced data engineer in Newcastle upon Tyne for a 12‑month FTC with pathway to permanent. You will build and optimise data pipelines using Java or Python, develop real-time streaming and batch data solutions, and work with Kafka, Flink or Spark alongside AWS services (Kinesis, MSK, Lambda, Glue).

You will implement governance, lineage, security, and quality controls, and support CI/CD with Azure DevOps, GitHub Actions or Jenkins, using Terraform and

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer & Analyst — Real-Time Pipelines
Senior Data Engineer & Analyst — Real-Time Pipelines

Opus RS • Newcastle upon Tyne

On-site
GBP 50,000 - 75,000
Data Engineer – Real‑Time Pipelines & AI (Hybrid)
Data Engineer – Real‑Time Pipelines & AI (Hybrid)

Opus Recruitment Solutions • West of England

Hybrid
GBP 60,000 - 71,000
Bonus scheme (10%)
Health insurance
Pension scheme
+1
Data Engineer
Data Engineer

Opus Recruitment Solutions • Newcastle upon Tyne

On-site
GBP 55,000 - 75,000
Data Engineer: Scalable Pipelines & Impact
Data Engineer: Scalable Pipelines & Impact

Experis UK • Newcastle upon Tyne

On-site
GBP 65,000 - 90,000
City-centre location
Learning & development
Collaborative team
Data Engineer
Data Engineer

develop • Newcastle upon Tyne

On-site
GBP 65,000 - 90,000
Data Engineer – 12-Month FTC, ETL & Real-Time Data
Data Engineer – 12-Month FTC, ETL & Real-Time Data

PSR Limited • London Borough of Newham

On-site
GBP 43,000 - 67,000
25 days annual leave plus bank holiday
Pension 8–12% depending on age
Private healthcare
+2
Data Engineer — Pipelines & Platform Reliability
Data Engineer — Pipelines & Platform Reliability

Neptune North Ltd. • Newcastle upon Tyne

On-site
GBP 50,000 - 70,000
Data Engineer
Data Engineer

Experis UK • Newcastle upon Tyne

On-site
GBP 65,000 - 90,000
City-centre location
Learning & development
Collaborative team
Data Engineer
Data Engineer

TyneStack Ltd • Newcastle upon Tyne

On-site
GBP 65,000 - 90,000
Hybrid working after probation
Defence Data Engineer - Cloud Pipelines & Spark
Defence Data Engineer - Cloud Pipelines & Spark

Electus Recruitment Solutions • Newcastle upon Tyne

On-site
GBP 60,000 - 90,000
Annual leave 25 days
Pension matched up to 6%
Private health insurance