Data Engineer

Green Recruitment Company; Southampton; On-site; GBP 42,000 - 45,000; Full time

Job summary

A leading Environmental and Sustainability Business is seeking a Data Engineer to join their Data-Technology team. This role involves designing, building and maintaining robust data solutions to support business needs and reporting requirements. The ideal candidate will have experience with Azure and a solid understanding of data engineering practices, contributing to a dynamic and impactful team.

Benefits

Attractive benefits package

Career development opportunities

Qualifications

• 3-5 years' cloud-based data engineering experience required.
• Experience with Azure Stack and leading technical projects.
• Formal data engineering qualification preferred.

Responsibilities

• Develop scalable data pipelines and maintain current Azure pipelines.
• Transform raw data into a harmonized layer for reporting.
• Lead engineering functions within the data team.

Skills

Cloud-based data engineering tools

PySpark

Analytical skills

Problem-solving skills

Communication

Education

Bachelor’s degree in Computing, Software Development, or similar

Tools

ADF

Synapse Analytics

S3

Lambda

Azure DevOps

Job description

The Green Recruitment Company is working with an Environmental and Sustainability Business that supports and empowers their customers' journey to net zero. To join their Data-Technology team, we have an opportunity for a Data Engineer to help support the wider business (cross-functional) to meet their reporting and data requirements.

About the role:

• The Data Engineer will work with the latest innovative technologies to design, build, and maintain data solutions, constructing processes to surface data both internally for reporting purposes and externally through the customer portal.

• The Data Engineer will be responsible for developing scalable data pipelines to integrate diverse data sources while ensuring data quality under the framework of a new Data Platform for real-time application integration and reporting. They will work closely with business stakeholders to support data-driven decision-making by delivering clean, well-structured datasets that can be utilized for reporting purposes in a performant, secure way.

Key responsibilities:

• Taking full ownership of assigned projects and BAU tasks.

• Maintaining current pipelines within Azure ADF and Synapse Analytics.

• Building a process to transform raw data from various CRM systems into a harmonized and curated layer.

• Developing the usage of event-driven topics for various subscribers.

• Investigating and documenting Architectural Spikes to foster best practices within the Data Team.

• Developing and creating data science tools to gain a deeper understanding of the customer base.

• Recording and updating work on the Project Management System (Azure DevOps).

• Owning and enhancing the BAU runbook for engineering operations.

• Developing instrumentation and monitoring of automated IT tasks.

• Taking a leadership role in the engineering functions of the data team.

Requirements:

• Qualifications: Bachelor’s degree or above in Computing, Software Development, or similar.

Experience required:

• 3-5 years' cloud-based data engineering experience.

• Experience with formal methodologies in data engineering.

• Experience leading or working within an engineering team or function.

• Experience with the Azure Stack.

• Experience working in a proactive analytics environment.

• Experience in the Utilities sector.

• Experience leading technical projects.

Skills & Technologies required:

• Proficiency in cloud-based data engineering tools (ADF, Synapse Analytics, S3, Lambda).

• Proficiency in using PySpark notebooks for ELT processes.

• Ability to foster and cultivate a culture of best practices.

• Strong analytical and problem-solving skills.

• Ability to work independently and within cross-functional teams.

• Excellent communication and documentation skills.

• Proven ability to evaluate and select engineering options.

• Formal data engineering qualification.

On offer: Salary £42,000 - £45,000 (depending on experience) with an attractive benefits package and career development opportunities.