Data Engineer

Matchtech; Scotland; On-site; GBP 60,000 - 80,000; Full time

Job summary

A leading recruitment agency is seeking Data Engineers for contract roles within the Defence & Security sector across various UK sites including Edinburgh and Newcastle. Candidates should possess strong data pipeline design skills, experience with ETL/ELT frameworks, and knowledge of Python and SQL. Active SC clearance is mandatory. This position requires onsite work at least 4 days a week and offers an initial contract duration of 6 months.

Qualifications

• Technical expertise in designing, building, and maintaining data pipelines and warehouses.
• Experience with ETL/ELT frameworks and Big Data Processing Tools.
• Knowledge of programming languages such as Python and SQL.

Responsibilities

• Design, develop, deploy, and support data infrastructure, pipelines, and architecture.
• Implement reliable, scalable, and tested solutions to automate data ingestion.
• Work with domain teams to scale data processing.

Skills

Data pipeline design

ETL/ELT frameworks

Big Data Processing Tools

Python

SQL

SQL/NoSQL database design

Education

Degree in a STEM field

Master's degree

Data engineering certification

Tools

Spark

Airflow

Hive

Job description

Overview

Location: Edinburgh, Newcastle, Luton, Bristol OR Southampton (fully onsite at one of these UK based sites)

Duration: 6 month initial contract

Inside IR35

Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working from their Luton, Bristol or Southampton site. Due to the secure environments, you will be required onsite at least 4 days per week.

Candidates must hold active SC clearance.

Key Responsibilities

• Design, develop, deploy, and support data infrastructure, pipelines, and architecture
• Implement reliable, scalable, and tested solutions to automate data ingestion
• Develop systems to manage batch processing and real-time streaming data
• Evaluate business needs and objectives
• Support the implementation of data governance requirements
• Facilitate pipelines that prepare data for prescriptive and predictive modelling
• Work with domain teams to scale data processing

Job Requirements

• Technical expertise in designing, building, and maintaining data pipelines and warehouses
• Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive)
• Knowledge of programming languages (e.g., Python, SQL)
• Hands-on experience with SQL/NoSQL database design
• Degree in a STEM field; a master's degree is a plus
• Data engineering certification (e.g., IBM Certified Data Engineer) is an advantage

Interested? Apply today via the link provided!