Data Engineer

SR2 REC LTD; Greater London; On-site; GBP 65,000 - 90,000; Full time

Job summary

SR2 Consulting is seeking Databricks Data Engineers for upcoming private sector engagements. You will sit with clients, understand their data needs, and build production pipelines that work reliably in real environments.

Experience with PySpark and SQL on Databricks, Delta Lake ingestion, and data quality/issue resolution is essential; familiarity with Unity Catalog and CI/CD is a plus. Consulting experience preferred.

Qualifications

• Track record delivering data engineering projects for clients in consultancy.
• Hands-on PySpark and SQL on Databricks for production pipelines.
• Experience ingesting data from source systems into Delta Lake for reporting/analytics/AI.
• Investigate failed jobs and improve pipeline performance.
• Explain design decisions to client stakeholders and work with their engineering teams.
• Databricks Data Engineer Associate or Professional certification would be a plus.
• Experience with Unity Catalog, batch or streaming ingestion, automated testing or CI/CD would also be valuable.
• We welcome experience across Azure, AWS and GCP.

Skills

Databricks

PySpark

SQL

Data pipelines

Data quality

CI/CD

Client-facing

Unity Catalog

Delta Lake

Azure

AWS

GCP

Tools

Unity Catalog

Delta Lake

CI/CD

Azure

AWS

GCP

Job description

Data Engineers

Databricks Data Engineers | Multiple Consulting Opportunities

SR2 Consulting is looking for Databricks Data Engineers for an upcoming private sector engagement. Previous client-facing consultancy experience is essential. We're looking for engineers who can sit with a client, understand what they need from their data and take responsibility for building pipelines that work in production.

Experience we're looking for

• A track record of delivering data engineering projects for clients in a consultancy or professional services role.

• Hands-on experience using PySpark and SQL on Databricks to build, deploy and support production pipelines.

• Experience ingesting data from source systems into Delta Lake and turning it into reliable datasets for reporting, analytics or AI.

• The ability to investigate failed jobs, resolve data quality issues and improve pipeline performance.

• Confidence explaining design decisions and trade-offs to client stakeholders and working alongside their engineering teams.

Databricks Data Engineer Associate or Professional certification would be a plus. Experience with Unity Catalog, batch or streaming ingestion, automated testing or CI/CD would also be valuable. We welcome experience across Azure, AWS and GCP.