Senior Data Engineer

Langham Recruitment; Castle Bromwich; Hybrid; GBP 54,000 - 66,000; Full time

Benefits offered by this job

Private healthcare

Discount scheme

Hybrid Working

Job summary

Langham Recruitment is partnered with a FTSE 250 housebuilder for a Senior Data Engineer role focused on Databricks, PySpark, Python and SQL to drive cloud-based data platform evolution. You will own ETL pipelines, ingestion frameworks, and Databricks administration, supporting BI reporting and AI initiatives.

The role offers hybrid working from the Birmingham area, with a competitive £60,000 base salary, a £4,900 car allowance or equivalent company car, and an up-to 12% annual bonus.

Qualifications

• Ideally a BSc / MSc in Computer Science or equivalent
• Databricks experience (ideally 3 years)
• Experience with Declarative Automation Bundles and Lakeflow Declarative Pipelines would be beneficial
• Python (including pyspark and declarative pipelines)
• SQL (DBSQL, Databricks AI functions a plus)

Responsibilities

• Development and maintenance of ETL pipelines
• Development and maintenance of in-house ingestion framework
• Administration of the Databricks platform including data governance
• Supporting the BI team in report development
• Supporting the wider business' data needs, including AI lab and other group functions

Skills

Databricks experience

Python (PySpark)

SQL

Declarative Pipelines

Lakeflow

Git / GitHub Actions

Power BI

Education

BSc / MSc in Computer Science

Tools

Databricks

Power BI

GitHub Actions

Job description

Senior Data Engineer - Databricks | FTSE 250 | Hybrid - Birmingham | £60,000 + 5K Car + up to 12% bonus

We are currently working with a FTSE 250 housebuilder who are looking for an experienced Data Engineer to join their team.

As a Senior Data Engineer, you'll join a small, highly collaborative team and play a key role in the development and evolution of the company's cloud-based data platform. You'll be responsible for developing and maintaining ETL pipelines, enhancing their in-house ingestion framework, administering the Databricks platform, and supporting a range of data initiatives across Business Intelligence, Analytics and AI.

This role would suit an experienced Data Engineer with strong Databricks, PySpark/Python and SQL expertise looking to step up in a senior role.

Responsibilities

• Development and maintenance of ETL pipelines


• Development and maintenance of our in-house ingestion framework


• Administration of the Databricks platform including data governance


• Supporting the Business Intelligence team in report development


• Supporting the wider business' data needs, including the AI lab and various other group functions

Key Skills & Qualifications

• Ideally a BSc / MSc in Computer Science (equivalent experience / similar degrees may also suffice)


• Databricks experience (ideally 3 years)


• Experience with Declarative Automation Bundles and Lakeflow Declarative Pipelines would be beneficial


• Python (including pyspark and declarative pipelines)


• SQL (especially DBSQL, experience with Databricks-native AI functions is a plus)

Preferred

• Databricks Data Engineering Associate / Professional Certifications


• git


• GitHub (including GitHub Actions)


• Star Schema Modelling


• Experience using Power BI or providing data for users of Power BI would be helpful in this regard


• Preparation of Feature Tables for Machine Learning


• Previous mentorship experience or line management would be a plus, but not essential

Salary and Benefits

• £60,000 base salary


• £4,900 car allowance or equivalent company car


• Up to 12% annual bonus


• Private healthcare


• Discount scheme


• Hybrid Working from either York, Birmingham or Warrington office