Senior Data Engineer: Databricks Pipelines & Modeling

Testing Site - JPMC

Lower Blandford St Mary

On-site

GBP 70,000 - 110,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Testing Site - JPMC is seeking a Data Engineer - Senior Associate to design and build scalable data pipelines on Databricks. You will collaborate with data architects and business analysts to deliver high-quality, compliant data solutions that power insights and AI enablement across Security Services.

Responsibilities include implementing data quality checks, documenting data flows, and ensuring governance standards.

Qualifications

Experience developing data pipelines on Databricks with Python-based transformations.
Strong Python data transformation skills including pandas.
Solid understanding of ETL concepts, data modelling, and pipeline design.
Experience with Spark and cloud data platforms.
Ability to document data flows and transformation logic to a high standard.
Familiarity with Jira for project tracking.
Collaborative mindset and strong communication skills.

Responsibilities

Design, build, and optimize data pipelines and transformation workflows on Databricks, leveraging Python and Spark.
Collaborate with Data Architects and Business Analysts to develop robust data models and clearly document data flows and ETL logic.
Implement and execute data quality checks and validation modules using Python.
Maintain transparency by tracking work and progress in Jira.
Ensure datasets and pipelines are registered in data catalogs and governance consoles.