Data Engineer

Matchtech; England; On-site; GBP 40,000 - 60,000; Full time

Job summary

A leading Defence & Security contractor is seeking Data Engineers for a 6-month contract across various UK sites. Candidates must have active SC clearance and expertise in designing data pipelines and infrastructure. Responsibilities include developing automated data ingestion solutions and managing real-time streaming data. Qualifications include a degree in a STEM field and experience with Big Data tools like Spark and Airflow. This role requires substantial onsite presence, effectively fostering a collaborative work environment.

Qualifications

• Candidates must hold active SC clearance.
• Technical expertise in designing and maintaining data pipelines.
• Knowledge of programming languages like SQL and Python.

Responsibilities

• Design, develop, deploy, and support data infrastructure.
• Implement solutions to automate data ingestion.
• Facilitate pipelines for prescriptive and predictive modeling.

Skills

Data pipeline design and maintenance

Experience with ETL/ELT frameworks

Knowledge of Python

Hands-on experience with SQL

Education

Degree in a STEM field

Data engineering certification

Tools

Spark

Airflow

Hive

Job description

Overview

Location: Edinburgh, Newcastle, Luton, Bristol OR Southampton (fully onsite at one of these UK based sites)

Duration: 6 month initial contract

Inside IR35

Role details: Our client, a prominent player in the Defence & Security sector, is looking for Data Engineers to join their team on a contract basis. Whilst the site preference is Edinburgh or Newcastle, the team can also support contractors working from their Luton, Bristol or Southampton site. Due to the secure environments, you will be required onsite at least 4 days per week.

Candidates must hold active SC clearance.

Responsibilities

• Design, develop, deploy, and support data infrastructure, pipelines, and architecture
• Implement reliable, scalable, and tested solutions to automate data ingestion
• Develop systems to manage batch processing and real-time streaming data
• Evaluate business needs and objectives
• Support the implementation of data governance requirements
• Facilitate pipelines that prepare data for prescriptive and predictive modelling
• Work with domain teams to scale data processing

Qualifications

• Technical expertise in designing, building, and maintaining data pipelines and warehouses
• Experience with ETL/ELT frameworks and Big Data Processing Tools (e.g., Spark, Airflow, Hive)
• Knowledge of programming languages (e.g., Python, SQL)
• Hands-on experience with SQL/NoSQL database design
• Degree in a STEM field; a master's degree is a plus
• Data engineering certification (e.g., IBM Certified Data Engineer) is an advantage

Interested? Apply today via the link provided!