Senior Data Engineer — Databricks, Snowflake & RegTech Impact

Novatus Global

Greater London

On-site

GBP 90,000 - 130,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Benefits offered by this job

Private Medical Insurance (via AXA)
Life Insurance - 4× salary
Flexible hours
Paid volunteering leave
Gym & fitness discounts
Office snacks and drinks

Job summary

Novatus, a RegTech SaaS and consulting practice, seeks a Senior Data Engineer to advance our configuration-driven data platform in Databricks and Snowflake for regulated use cases. You will write clean, well-tested code and provide technical leadership in a growing team.

You will help modernize our data infrastructure as we scale, migrating from Python scripts to Databricks and Snowflake, and ensure auditability, data quality, and reliability across client deployments.

Qualifications

  • 8+ years as a software engineer, including 5+ years in data engineering.
  • Experience designing auditable, reproducible data pipelines in regulated or high-integrity environments using Python and PySpark.
  • Able to write and optimize complex SQL queries on large data sets.
  • Strong data modeling and warehouse design fundamentals.
  • Strong software engineering fundamentals: clean code, DRY, SOLID, automated testing, CI/CD, and observability.
  • Deep experience with a cloud lakehouse / data warehouse (Databricks, Snowflake, BigQuery, Redshift, EMR).
  • Experience with a workflow orchestrator (Airflow, Dagster, or Databricks Workflows).
  • Proven system and platform design judgment with ability to own architectural decisions.

Responsibilities

  • Design and evolve data framework in Databricks and Snowflake.
  • Coach and mentor junior engineers, and lead design reviews.
  • Design, build, and optimize data pipelines using Databricks, Python and PySpark, with Kafka.
  • Ensure pipelines are auditable, lineage-aware, idempotent, and resilient in regulated environments.
  • Implement robust data quality controls including testing, validation, monitoring, and alerting.
  • Drive performance optimization across Spark and Snowflake workloads; collaborate with Product, Engineering, DevOps, and Regulatory teams.
  • Contribute to the continuous improvement of our development processes and tools.

Skills

Databricks
PySpark
SQL
Data modeling
CI/CD
Testing & observability
Python
Cloud data lakehouse
Kafka
Leadership

Tools

Airflow
Snowflake
Databricks
Terraform
BigQuery/Redshift

Job description

Novatus, a RegTech SaaS and consulting practice, seeks a Senior Data Engineer to advance our configuration-driven data platform in Databricks and Snowflake for regulated use cases. You will write clean, well-tested code and provide technical leadership in a growing team.

You will help modernize our data infrastructure as we scale, migrating from Python scripts to Databricks and Snowflake, and ensure auditability, data quality, and reliability across client deployments.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior Data Engineer
Senior Data Engineer

Novatus Global • Greater London

On-site
GBP 90,000 - 130,000
Private Medical Insurance (via AXA)
Life Insurance - 4× salary
Flexible hours
+3
Senior Data Platform Architect: Databricks & Snowflake Lead
Senior Data Platform Architect: Databricks & Snowflake Lead

Capita • Greater London

Remote
GBP 110,000 - 140,000
Homebased working
23 days’ holiday (rising to 27)
Matched pension
+3
Senior Data Engineer - Client-Facing Data Platform Lead
Senior Data Engineer - Client-Facing Data Platform Lead

Decision Inc. • Greater London

On-site
GBP 70,000 - 110,000
Senior Data Engineer - Databricks Platform Lead
Senior Data Engineer - Databricks Platform Lead

PRIMARK • Normanton on Trent

On-site
GBP 70,000 - 100,000
Senior Data Engineer - Databricks
Senior Data Engineer - Databricks

ISx4 Group • Belfast City District

Hybrid
GBP 70,000 - 100,000
Senior Data Engineer - Databricks Platform Lead
Senior Data Engineer - Databricks Platform Lead

TD • Belfast City District

On-site
GBP 90,000 - 120,000
Senior Databricks & Snowflake Data Architect, Lakehouse Lead
Senior Databricks & Snowflake Data Architect, Lakehouse Lead

Statestreet • Greater London

On-site
GBP 110,000 - 170,000
Flexible work-life support
Paid volunteer days
Employee networks
Databricks Tech Lead: Data Platform & Architecture
Databricks Tech Lead: Data Platform & Architecture

Sentior, Ltd. • Greater London

Hybrid
GBP 90,000 - 130,000
Databricks Platform Lead, Data Engineer
Databricks Platform Lead, Data Engineer

Primark • Reading

On-site
GBP 80,000 - 120,000
Senior Snowflake Data Platform Engineer
Senior Snowflake Data Platform Engineer

VBeyond Europe • Greater London

Hybrid
GBP 90,000 - 140,000