Data Engineer

Matchtech; Gloucester; On-site; GBP 45,000 - 65,000; Full time

Job summary

A prominent player in the Defence & Security sector is looking for Data Engineers to join their team on a contract basis in the United Kingdom. The role requires candidates to hold active SC clearance and be available onsite at least 4 days per week. Responsibilities include designing and supporting data infrastructure, developing systems for data processing, and implementing data governance. Ideal candidates will have expertise in ETL/ELT frameworks, programming languages like Python and SQL, and relevant educational qualifications.

Qualifications

• Technical expertise in designing and maintaining data pipelines and warehouses.
• Experience with ETL/ELT frameworks and Big Data Processing Tools.
• Knowledge of programming languages such as Python and SQL.

Responsibilities

• Design, develop, deploy, and support data infrastructure, pipelines, and architecture.
• Implement automated solutions for data ingestion.
• Support the implementation of data governance requirements.

Skills

Designing data pipelines

ETL/ELT frameworks

Big Data Processing Tools (e.g., Spark, Airflow, Hive)

Python

SQL

Education

Degree in a STEM field

Data engineering certification (e.g., IBM Certified Data Engineer)

Tools

SQL/NoSQL databases

Job description

Overview

Location: Edinburgh, Newcastle, Luton, Bristol OR Southampton (fully onsite at one of these UK based sites)

Duration: 6 month initial contract

Inside IR35

Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working from their Luton, Bristol or Southampton site. Due to the secure environments, you will be required onsite at least 4 days per week.

Candidates must hold active SC clearance.

Responsibilities

• Design, develop, deploy, and support data infrastructure, pipelines, and architecture
• Implement reliable, scalable, and tested solutions to automate data ingestion
• Develop systems to manage batch processing and real-time streaming data
• Evaluate business needs and objectives
• Support the implementation of data governance requirements
• Facilitate pipelines that prepare data for prescriptive and predictive modelling
• Work with domain teams to scale data processing

Qualifications

• Technical expertise in designing, building, and maintaining data pipelines and warehouses
• Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive)
• Knowledge of programming languages (e.g., Python, SQL)
• Hands-on experience with SQL/NoSQL database design
• Degree in a STEM field; a master's degree is a plus
• Data engineering certification (e.g., IBM Certified Data Engineer) is an advantage

Interested? Apply today via the link provided!