Senior Data Engineer - Databricks, AWS, Hybrid UK Contract

Rullion - Eon; Nottingham; Hybrid; GBP 60,000 - 80,000; Full time

Job summary

A major UK energy provider is seeking a Data Engineer to join an ambitious data transformation journey using Databricks. This full-time, initially 6-month contract role focuses on developing efficient data pipelines and managing an enterprise data model. The ideal candidate brings extensive experience in Python, SQL, and data governance. The position offers a hybrid work environment with one day a week in the Nottingham office and various opportunities for professional growth.

Qualifications

• Extensive experience in Python, including advanced concepts.
• Strong understanding of SQL, database design, and data architecture.
• Experience with Databricks and/or Spark is preferred.
• Skilled in data extraction and real-time data processing.
• Understanding of unit and integration testing.

Responsibilities

• Develop and maintain scalable data pipelines within Databricks.
• Build and manage an enterprise data model within Databricks.
• Integrate new data sources into the platform.
• Create and maintain documentation for data pipelines.
• Ensure data quality and reliability processes are effective.

Skills

Python

SQL

Databricks

Spark

Data governance

Git

Amazon Web Services

Job description

A major UK energy provider is seeking a Data Engineer to join an ambitious data transformation journey using Databricks. This full-time, initially 6-month contract role focuses on developing efficient data pipelines and managing an enterprise data model. The ideal candidate brings extensive experience in Python, SQL, and data governance. The position offers a hybrid work environment with one day a week in the Nottingham office and various opportunities for professional growth.