Data Engineer (ADF / Databricks)

Michael Page; Nottingham; On-site; GBP 55,000 - 57,000; Full time

Benefits offered by this job

Excellent Benefits Package

Job summary

Michael Page is recruiting a Data Engineer in Nottingham to join a leading global commercial retailer. You will develop and maintain data pipelines, optimise databases, design ETL processes, and ensure data quality as part of the data build and enablement strategy.

Reporting into the Lead Data Engineer, you will work with cross-functional teams to derive insights from data assets while ensuring performance, security, and scalability across data lakes, warehouses, and reporting platforms.

Qualifications

• Proven experience as a Data Engineer or similar role.
• Full UK Driving Licence.
• Strong SQL skills with relational and NoSQL databases.
• Experience with data pipeline and ETL tools (Azure Data Factory, Azure Logic Apps, Databricks, APIs).
• Understanding of Data Lakes, Synapse, Delta Lakes.
• Proficiency in Python, Java or Scala.

Responsibilities

• Develop and maintain robust data pipelines to ingest, process, and transform data from various sources, ensuring data reliability and quality.
• Implement seamless data integration processes supporting the continuous flow of information across the organisation.
• Design, optimise and manage databases to ensure data retrieval and storage performance, availability and scalability.
• Craft efficient ETL processes transforming raw data into usable formats and enrichment, for improved efficiency.
• Build and maintain data warehouses for structured storage, enabling easy reporting and analysis.
• Implement data quality checks and validation to ensure high accuracy and monitor data integrity.
• Optimise data pipelines and databases for performance and scalability, forecasting future needs.
• Enforce robust data security measures to safeguard privacy and prevent unauthorised access.
• Maintain documentation for data pipelines, processes and models for knowledge transfer.
• Collaborate with cross-functional teams to understand requirements and deliver effective solutions.

Skills

SQL proficiency

Attention to detail

Collaborative team player

Tools

Azure Data Factory

Azure Logic Apps

Databricks

APIs

Python

Java

Scala

Data Lakes

Job description

This leading commercial retailer are looking for an experienced Data Engineer to join them as part of their continued data build & enablement strategy. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes, designing data models and ensuring data quality.

Client Details

Leading Global Commercial Retailer based in Nottingham.

Description

This leading commercial retailer are looking for an experienced Data Engineer to join them as part of their continued data build & enablement strategy. As a Data Engineer, you will be responsible for developing and maintaining data pipelines, optimising databases, creating ETL processes, designing data models and ensuring data quality. Reporting into the Lead Data Engineer, you will use your expertise in data engineering to derive valuable insights from data assets and shape data excellence across the organisation.

Key Responsibilities

• Develop and maintain robust data pipelines to ingest, process, and transform data from various sources, while ensuring data reliability and quality
• Implement seamless data integration processes supporting the continuous flow of information across the organisation
• Design, optimise and manage databases to proficiently oversee data retrieval and storage, prioritising performance, availability and scalability
• Craft efficient ETL processes transforming raw data into usable formats, including data cleaning, aggregation, and enrichment, streamlining data processing for enhanced efficiency
• Build and maintain data warehouses for structured data storage, ensuring it is organised for easy retrieval, reporting and analysis
• Implement stringent data quality checks and validation processes to ensure high accuracy, proactively monitoring and rectifying data integrity issues
• Optimise data pipelines and databases for performance and scalability, anticipating future growth and evolving business needs
• Enforce robust data security measures to uphold privacy regulations and safeguard against unauthorised access, ensuring data asset protection
• Maintain comprehensive documentation for data pipelines, processes, and models, ensuring seamless knowledge transfer and ongoing support
• Collaborate closely with cross-functional teams, fostering a data-driven culture by understanding requirements and delivering effective solutions together

Profile

Key Skills & Expertise:

• Proven experience as a Data Engineer or similar role
• Full UK Driving Licence required
• Strong SQL skills with relational and NoSQL databases
• Demonstrated experience with data pipeline and ETL tools (e.g. Azure Data Factory, Azure Logic Apps, Databricks, API's)
• Understanding of different data environments (Data Lakes, Synapse, Delta Lakes)
• Proficiency in programming languages such as Python, Java, or Scala
• Sound knowledge of data modelling, database design principles, data warehousing and data visualisation tools
• Excellent attention to detail and creativity to design, develop and inform overall business strategy
• Ability to work collaboratively and is open to new ideas whilst appreciating the difference each person makes

Job Offer

• Permanent Data Engineer position.
• Salary of £55,000 to £57,000, dependent on the level of experience.
• Excellent Benefits Package
• One day per week onsite in Nottingham, on Tuesdays.

People are at the heart of Michael Page. We are committed to creating an inclusive environment. As an inclusive recruiter we welcome applications from people of all backgrounds, identities and experiences. If you require any adjustments or accommodations during the recruitment process, we'll work with you to ensure you can perform at your best