Data Engineer – Real‑Time Pipelines & AI (Hybrid)

Opus Recruitment Solutions

West of England

Hybrid

GBP 60,000 - 71,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Bonus scheme (10%)
Health insurance
Pension scheme
33 days holiday

Job summary

Opus Recruitment Solutions in Bristol is seeking a Data Engineer to join a hybrid team. The role focuses on building scalable data pipelines using Python, SQL and PySpark, with Databricks, Kafka and AWS in the stack.

You will work on real-time platforms processing billions of sensor readings monthly, collaborating with Data Scientists and Software Engineers to shape the data architecture and drive AI/ML initiatives.

Qualifications

  • Strong commercial experience as a Data Engineer.
  • Advanced Python and SQL skills.
  • Strong PySpark experience.
  • Experience building and maintaining scalable data pipelines.
  • Understanding of data modelling and database design principles.
  • Strong analytical and problem-solving capabilities.
  • Excellent communication and stakeholder engagement skills.
  • Degree in Computer Science, Mathematics, Statistics or a related discipline would be advantageous.

Responsibilities

  • Build and optimise large-scale data pipelines.
  • Work with billions of data points generated from IoT devices.
  • Develop solutions using Python, SQL and PySpark.
  • Gain exposure to Databricks, Kafka and streaming technologies.
  • Contribute to Machine Learning and AI initiatives.
  • Work alongside Data Scientists and Software Engineers.
  • Influence architecture and engineering best practices.
  • Play a key role in exciting greenfield projects.

Skills

Python
SQL
PySpark
Data pipelines
Stakeholder engagement

Education

Bachelor's degree in Computer Science, Mathematics, Statistics or related

Tools

Databricks
Kafka
AWS

Job description

Opus Recruitment Solutions in Bristol is seeking a Data Engineer to join a hybrid team. The role focuses on building scalable data pipelines using Python, SQL and PySpark, with Databricks, Kafka and AWS in the stack.

You will work on real-time platforms processing billions of sensor readings monthly, collaborating with Data Scientists and Software Engineers to shape the data architecture and drive AI/ML initiatives.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer & Analyst — Real-Time Pipelines
Senior Data Engineer & Analyst — Real-Time Pipelines

Opus RS • Newcastle upon Tyne

On-site
GBP 50,000 - 75,000
Data Engineer – Real-Time Pipelines (12m FTC, UK)
Data Engineer – Real-Time Pipelines (12m FTC, UK)

Opus Recruitment Solutions • Newcastle upon Tyne

On-site
GBP 55,000 - 75,000
Data Engineer
Data Engineer

TRIA • West of England

Hybrid
GBP 65,000 - 90,000
Data Engineer: AI Pipelines on Databricks (Hybrid Cambridge)
Data Engineer: AI Pipelines on Databricks (Hybrid Cambridge)

Whitehall Resources Limited • Cambridgeshire and Peterborough

Hybrid
GBP 70,000 - 90,000
Data Engineer — AI-Driven Data Pipelines
Data Engineer — AI-Driven Data Pipelines

Transformuk • Greater London

On-site
GBP 65,000 - 95,000
Holiday entitlement, 28 days (buy/sell
Private healthcare
Pension eligibility
+5
Data Engineer - AWS Databricks Pipelines (Hybrid)
Data Engineer - AWS Databricks Pipelines (Hybrid)

Edenred SE • Swindon

Hybrid
GBP 59,000 - 72,000
25 days annual leave
Hybrid working environment
Pension scheme
+9
Data Engineer — Python & AWS Pipelines + APIs
Data Engineer — Python & AWS Pipelines + APIs

Instil Software Ltd • Belfast

Hybrid
GBP 65,000 - 90,000
Discretionary annual bonus
Hybrid working
Private healthcare
+4
AWS Data Engineer (PySpark/AI) - Hybrid London
AWS Data Engineer (PySpark/AI) - Hybrid London

Datatech Analytics • City Of London

Hybrid
GBP 45,000 - 75,000
Data Engineer – Real-time Pipelines & AI Enablement
Data Engineer – Real-time Pipelines & AI Enablement

Fundment Limited • Greater London

Hybrid
GBP 70,000 - 100,000
Senior Data Engineer - Cloud Pipelines & Analytics
Senior Data Engineer - Cloud Pipelines & Analytics

Data Idols • Greater London

Hybrid
GBP 80,000 - 95,000