Data Engineering Consultant

Electus Recruitment Solutions; North East; On-site; GBP 60,000 - 90,000; Full time

Benefits offered by this job

25 days' annual leave

Pension contributions matched up to 6%

Private health insurance through Bupa

Discretionary bonus

Job summary

Electus Recruitment Solutions is seeking a data engineer to build data-intensive applications and production pipelines for Defence consultancy projects in the UK. Based in Newcastle upon Tyne, this site-based role involves handling large datasets using SQL and Python to deliver end-user data solutions.

You will work with cloud platforms, Spark and Databricks, and Airflow, improving data quality and reliability while collaborating with analysts, scientists and engineers across varied engagements.

Qualifications

• Hands-on data engineering experience with large datasets.
• Strong SQL and Python programming skills.
• Experience building production data pipelines.
• Familiarity with cloud platforms and distributed computing.
• Ability to communicate technical concepts to analysts, scientists and engineers.

Responsibilities

• Designing and developing data-intensive applications and production pipelines.
• Building data solutions from ingestion to end-user consumption.
• Working with complex, sensitive and challenging datasets.
• Developing practical solutions to make data usable in operational environments.
• Testing and improving data products to ensure reliability and quality.
• Contributing to Defence consultancy projects with different technical challenges.

Skills

SQL

Python

Data pipelines

Cloud platforms

Communication

Tools

Spark

Databricks

AWS

Azure

Google Cloud Platform

Airflow

Job description

Build data solutions for complex Defence challenges while broadening your technical experience across varied consultancy projects. Develop your skills across modern data engineering technologies and production environments.

What you will need

• Hands-on data engineering experience.
• Strong SQL and Python programming skills.
• Experience building production data pipelines.
• Understanding of cloud platforms and distributed computing.

Excellent remuneration and rewards

Excellent remuneration package plus a discretionary bonus.

What you will be working on

• Designing and developing data-intensive applications and production pipelines.
• Building data solutions from initial ingestion through to end-user consumption.
• Working with complex, sensitive and challenging datasets.
• Developing practical solutions to make difficult-to-access data usable in operational environments.
• Testing and improving data products to ensure reliability and quality.
• Contributing to varied Defence consultancy projects with different technical challenges.

Your experience

• Strong experience working with SQL and large datasets.
• Python programming and sound software engineering practices.
• Exposure to Spark, Databricks, AWS, Azure or Google Cloud Platform.
• Experience with data orchestration tools such as Airflow.
• Understanding of data modelling, data quality and feature engineering.
• Ability to communicate technical concepts and collaborate with analysts, scientists and engineers.

Benefits and development

The employer supports your development and wellbeing through:

• 25 days' annual leave plus bank holidays.
• Pension contributions matched up to 6%.
• Private health insurance through Bupa.
• Discretionary bonus.

Location and working pattern

Based in Newcastle upon Tyne, this is a site-based permanent position. Regular travel to client sites across the UK is also required. Some assignments may involve two to three days per week at client sites or shorter periods of full-time onsite working. Travel expenses and hotel arrangements are provided.

This role offers the opportunity to develop your technical capability across a broad range of data engineering challenges while contributing to work supporting UK Defence and national security.

Security Clearance: The role requires British Citizenship (including dual UK nationals with British citizenship). Successful candidates will be required to undergo HMG Baseline Personnel Security Standard (BPSS) checks after offer, managed by the employer's Personnel Security Team.

This is a permanent role.