Senior Data Engineer

ZipRecruiter; City Of London; On-site; GBP 65,000 - 85,000; Full time

Job summary

A forward-thinking technology company in London seeks a Senior Data Engineer to design and deliver scalable data platforms. In this hands-on role, you'll collaborate with teams to transform complex data into reliable systems and mentor junior engineers. Ideal for candidates with strong Python skills and experience with Databricks, Spark, and cloud environments. Enjoy benefits like unlimited leave and open salaries.

Benefits

Unlimited annual leave

Open salaries & stock options

Private health & life insurance

Qualifications

• Solid experience as a Senior Data Engineer in complex enterprise environments.
• Strong coding skills in Python; knowledge of Scala or functional programming is a plus.
• Hands-on experience with cloud platforms like AWS, Azure, or GCP.

Responsibilities

• Design and build modern data platforms using Databricks, Apache Spark, and cloud services.
• Develop robust pipelines for data ingestion from complex sources.
• Collaborate with data scientists to deploy production-grade AI/ML systems.

Skills

Data platform design

Python programming

Data modeling

Cloud platforms

CI/CD practices

Mentorship

Tools

Databricks

Apache Spark

Snowflake

Docker

Kubernetes

Job description

Overview

At Sahaj Software, we’re not just shipping pipelines — we’re designing purpose-built data platforms that solve complex challenges for some of the UK’s most forward-thinking organisations. We believe in craftsmanship, autonomy, and trust. No hierarchies, no bureaucracy — just small teams solving big problems with modern tech.

Why this role?

As a Senior Data Engineer, you’ll own the design and delivery of scalable data platforms, pipelines, and architectures that power real business decisions. You’ll work closely with data scientists, engineers, and stakeholders to transform messy data into clean, reliable, and production-grade systems.

This is a hands-on, high-impact role where you’ll influence technical direction while staying close to the code. Perfect if you want scope for growth without going “post-technical.”

What you’ll do

• Design and build modern data platforms using Databricks, Apache Spark, Snowflake, and cloud-services (AWS, Azure, or GCP).
• Develop robust pipelines for real-time and batch data ingestion from diverse and complex sources.
• Model and optimise data for performance, visibility, and downstream analytics/ML use cases.
• Champion best practices: CI/CD, TDD, GitOps, observability, schema validation, and data quality.
• Collaborate with data scientists and ML engineers to deploy production-grade AI/ML systems.
• Guide clients on data strategy, architecture, and platform modernisation.
• Mentor and influence engineers across Sahaj, helping grow our collective data engineering capability.

What we’re looking for

• Solid experience as a Senior Data Engineer in complex enterprise environments.
• Strong coding skills in Python (Scala or functional a plus).
• Expertise with Databricks, Apache Spark, and Snowflake (HDFS/HBase also useful).
• Experience integrating large, messy datasets into reliable, scalable data products.
• Strong understanding of data modelling, orchestration, and automation.
• Hands-on experience with cloud platforms (AWS, Azure, GCP) and containerisation (Docker, Kubernetes).
• A craftsman’s mindset: you care about code quality, maintainability, and doing things the right way.

What you’ll get at Sahaj

• Unlimited annual leave – we trust you to manage your time.
• Open salaries & stock options – transparency from the ground up.
• Private health & life insurance – covered by us.
• Flat structure, no hierarchy – you own your work, and your voice counts.