Databricks Data Engineer — Client-Facing Pipelines

SR2 REC LTD; Greater London; On-site; GBP 65,000 - 90,000; Full time

Job summary

SR2 Consulting is seeking Databricks Data Engineers for upcoming private sector engagements. You will sit with clients, understand their data needs, and build production pipelines that work reliably in real environments.

Experience with PySpark and SQL on Databricks, Delta Lake ingestion, and data quality/issue resolution is essential; familiarity with Unity Catalog and CI/CD is a plus. Consulting experience preferred.

Qualifications

• Track record delivering data engineering projects for clients in consultancy.
• Hands-on PySpark and SQL on Databricks for production pipelines.
• Experience ingesting data from source systems into Delta Lake for reporting/analytics/AI.
• Investigate failed jobs and improve pipeline performance.
• Explain design decisions to client stakeholders and work with their engineering teams.
• Databricks Data Engineer Associate or Professional certification would be a plus.
• Experience with Unity Catalog, batch or streaming ingestion, automated testing or CI/CD would also be valuable.
• We welcome experience across Azure, AWS and GCP.

Skills

Databricks

PySpark

SQL

Data pipelines

Data quality

CI/CD

Client-facing

Unity Catalog

Delta Lake

Azure

AWS

GCP

Tools

Unity Catalog

Delta Lake

CI/CD

Azure

AWS

GCP

Job description

SR2 Consulting is seeking Databricks Data Engineers for upcoming private sector engagements. You will sit with clients, understand their data needs, and build production pipelines that work reliably in real environments.

Experience with PySpark and SQL on Databricks, Delta Lake ingestion, and data quality/issue resolution is essential; familiarity with Unity Catalog and CI/CD is a plus. Consulting experience preferred.