Data Engineer - Databricks Pipelines & Data Governance

Department for Culture, Media and Sport; Manchester; On-site; GBP 50,000 - 70,000; Full time

Job summary

Department for Culture, Media and Sport in Manchester is seeking an SEO Data Engineer / Data Engineer to translate user requirements into production-grade data architectures. You will build and maintain data pipelines on the Databricks platform, ensuring secure, reliable access to data for analytics and BI.

You will work in an agile multidisciplinary team, collaborating with data analysts and business stakeholders to deliver value and maintain data quality and governance.

Responsibilities

• Write clean, efficient, reusable and tested code with version control and CI/CD automation.
• Design and maintain robust ETL/ELT pipelines and data flows using Databricks.
• Design and maintain structured data models for conformant, query-friendly data.
• Monitor, troubleshoot and optimise pipeline performance and system reliability.
• Collaborate with data analysts, data scientists and stakeholders in agile delivery.
• Apply data classification, security standards and governance to manage access and metadata.

Skills

Databricks

ETL/ELT pipelines

CI/CD automation

Data modelling

Data governance

Security standards

Cross-functional collaboration

Tools

Databricks

Job description

Department for Culture, Media and Sport in Manchester is seeking an SEO Data Engineer / Data Engineer to translate user requirements into production-grade data architectures. You will build and maintain data pipelines on the Databricks platform, ensuring secure, reliable access to data for analytics and BI.

You will work in an agile multidisciplinary team, collaborating with data analysts and business stakeholders to deliver value and maintain data quality and governance.