Senior Data Engineer (databricks)

iO Associates; Reading; On-site; GBP 80,000 - 100,000; Full time

Job summary

A leading consultancy is seeking an experienced Contract Data Engineer to join on crucial digital transformation projects with top-tier banks. This role involves designing scalable data solutions using tools like Databricks and Python, contributing to both greenfield projects and enhancements on existing applications. Applicants should have solid experience with event streaming and SQL, along with a passion for impacting the future of finance.

Qualifications

• Strong hands-on experience with Databricks, Delta Lake.
• Advanced Python/PySpark and big data pipeline development.
• Familiar with event streaming tools like Kafka.

Responsibilities

• Design and build scalable, cloud-based data solutions.
• Support major digital transformation projects with Tier 1 banks.
• Enhance high-traffic financial applications.

Skills

Databricks

Python/PySpark

Spark Structured Streaming

SQL

Kafka

Tools

Azure DevOps

GitHub Actions

Job description

Contract Data Engineer
Financial Services | 6+ Months | Competitive Day Rate
My client, a global consultancy, is looking for an experienced Data Engineer to join on a contract basis to support major digital transformation projects with Tier 1 banks.
You'll help design and build scalable, cloud-based data solutions using Databricks, Python, Spark, and Kafka-working on both greenfield initiatives and enhancing high-traffic financial applications.
Key Skills & Experience:

• 
  Strong hands-on experience with Databricks, Delta Lake, Spark Structured Streaming, and Unity Catalog
• 
  Advanced Python/PySpark and big data pipeline development
• 
  Familiar with event streaming tools (Kafka, Azure Event Hubs)
• 
  Solid understanding of SQL, data modelling, and lakehouse architecture
• 
  Experience deploying via CI/CD tools (e.g., Azure DevOps, GitHub Actions)

Nice to Have:

• 
  Knowledge of Scala/Java
• 
  Understanding of GDPR and handling sensitive data

This is a contract role (UK-based) offering the chance to work on high-impact projects shaping the future of finance with some onsite presence required.