Senior Data Engineer

Langham Recruitment; Warrington; Hybrid; GBP 54,000 - 66,000; Full time

Benefits offered by this job

Private healthcare

Discount scheme

Hybrid working

Job summary

Langham Recruitment is partnered with a FTSE 250 housebuilder seeking a Senior Data Engineer for hybrid work in Warrington. You will own ETL pipelines, evolve an in-house ingestion framework and administer the Databricks platform to enable BI, analytics and AI initiatives.

The role requires Databricks, PySpark/Python and SQL expertise, plus mentoring capability. A strong data engineering background and collaboration across teams are essential.

Qualifications

• Bachelor's or master’s degree in a computing field or equivalent experience.
• Strong Databricks background with 3+ years in data engineering.
• Experience with Python/PySpark and SQL, including DBSQL.

Responsibilities

• Develop and maintain ETL pipelines and the ingestion framework.
• Administer the Databricks platform and data governance.
• Support BI team with report development and data needs.

Skills

Databricks expertise

Python (PySpark)

SQL proficiency

Git & GitHub Actions

Mentoring

Education

BSc / MSc in Computer Science

Tools

Databricks

Lakeflow Declarative Pipelines

Declarative Automation Bundles

Power BI

GitHub Actions

Job description

Senior Data Engineer – Databricks | FTSE 250 | Hybrid – Warrington | £60,000 + 5K Car + up to 12% bonus

We are currently working with a FTSE 250 housebuilder who are looking for an experienced Data Engineer to join their team.

As a Senior Data Engineer, you'll join a small, highly collaborative team and play a key role in the development and evolution of the company's cloud-based data platform. You'll be responsible for developing and maintaining ETL pipelines, enhancing their in-house ingestion framework, administering the Databricks platform, and supporting a range of data initiatives across Business Intelligence, Analytics and AI.

This role would suit an experienced Data Engineer with strong Databricks, PySpark/Python and SQL expertise looking to step up in a senior role.

Responsibilities

• Development and maintenance of ETL pipelines


• Development and maintenance of our in-house ingestion framework


• Administration of the Databricks platform including data governance


• Supporting the Business Intelligence team in report development


• Supporting the wider business' data needs, including the AI lab and various other group functions

Key Skills & Qualifications

• Ideally a BSc / MSc in Computer Science (equivalent experience / similar degrees may also suffice)


• Databricks experience (ideally 3 years)


• Experience with Declarative Automation Bundles and Lakeflow Declarative Pipelines would be beneficial


• Python (including pyspark and declarative pipelines)


• SQL (especially DBSQL, experience with Databricks-native AI functions is a plus)


• Databricks Data Engineering Associate / Professional Certifications


• git


• GitHub (including GitHub Actions)


• Star Schema Modelling


• Experience using Power BI or providing data for users of Power BI would be helpful in this regard


• Preparation of Feature Tables for Machine Learning


• Previous mentorship experience or line management would be a plus, but not essential

Salary and Benefits

• £60,000 base salary


• £4,900 car allowance or equivalent company car


• Up to 12% annual bonus


• Private healthcare


• Discount scheme


• Hybrid Working from either York, Birmingham or Warrington office