Senior Data Engineer

Public Sector Resourcing, managed by AMS; United States; A distancia; USD 86.000 - 119.000; Jornada completa

Descripción de la vacante

The Ministry of Justice (Synergy Programme) is seeking a Senior Data Engineer to design, build and maintain automated data pipelines on AWS, ensuring data preparation for analysis and migration readiness. The role involves collaboration with Data Analysts and other stakeholders to translate requirements into scalable, secure cloud solutions.

Applicants should have strong hands-on AWS data engineering experience, Python and SQL proficiency, and familiarity with SDLC, CI/CD and IaC practices.

Formación

• Strong hands-on AWS Data Engineering experience with Python and SQL
• Experience with building/maintaining automated data pipelines
• Familiarity with infrastructure-as-code and AWS services
• Understanding SDLC, version control (git), automated testing (pytest) and CI/CD (GitHub Actions)
• Experience with SplashBI and HR/Finance/Procurement data sources (desirable)
• Ability to operate in fast-paced delivery environments and manage priorities

Responsabilidades

• Design, build, and maintain robust, automated data pipelines from SplashBI to AWS data platform
• Collaborate with Data Analysts to translate requirements into technical solutions
• Identify opportunities to automate and re-engineer data processes for scaling
• Maintain secure AWS infrastructure using infrastructure-as-code and best practices
• Develop and optimize code, tools, and services for analysts to access data
• Monitor and optimize pipelines to meet migration readiness milestones
• Deliver technical solutions within tight deadlines in a programme environment
• Collaborate with stakeholders to understand requirements and deliver data solutions

Conocimientos

Python

SQL

AWS

Data pipelines

Git

Automated testing

CI/CD

GitHub Actions

Herramientas

SplashBI

Oracle EBS

Descripción del empleo

On behalf of The Ministry of Justice, we are looking for a Senior Data Engineer (Inside IR35) for a 6 month contract based primarily remote (occasional travel to MoJ offices and team meetings, typically in London).

The Synergy Programme is a large-scale transformation programme consisting of four Government departments, MOJ (Ministry of Justice), DWP (Department for Work and Pensions), DEFRA (Department for Environment, Food and Rural Affairs) and HO (Home Office). They will come together to replace their current back-office systems and introduce new ways of working for 220,000 civil servants combined. High-quality, accurate data is fundamental to ensuring a successful transition and enabling effective business processes, reporting and operations within the new ERP platform.

The Data Engineer will play a critical role in supporting the MoJ contribution to the Synergy Programme by providing the technical capability required to extract, transform, manage and prepare source data for analysis. This role directly supports key programme priorities, including data quality improvement and data migration readiness.

This role requires strong hands‑on AWS Data Engineering experience, with a particular focus on building and maintaining automated data pipelines and cloud‑based data solutions using AWS services, Python and SQL.

As a Senior Data Engineer, your main responsibilities will include:

• Designing, building and maintaining robust, scalable and automated data pipelines that extract source data from SplashBI and load it into the programme's AWS data platform.
• Working closely with Data Analysts to understand user needs and data requirements, translating them into technical requirements and solutions.
• Identifying opportunities to improve, automate, reuse and re‑engineer data engineering processes to increase efficiency, enable scaling and reduce manual effort.
• Maintaining secure and sustainable AWS cloud infrastructure using infrastructure-as-code principles and best practice development approaches, deploying solutions using a range of AWS services in a reproducible and sustainable manner.
• Developing and optimising code, tools and services that enable analysts to access and use data effectively and efficiently.
• Proactively monitor, maintain and optimise data pipelines to ensure source data is available to analysts in line with programme timelines and migration readiness milestones.
• Operate effectively in a fast‑paced programme environment, managing competing priorities and delivering technical solutions to demanding timescales.

Essential:

• Strong hands on AWS Data Engineering experience, including developing, maintaining and optimising robust and scalable automated data pipelines using Python, SQL and AWS cloud services.
• Experience working in a technical team, preferably one that uses Python and SQL, as well as strong technical skills in these languages.
• Working with a range of data sources and source systems and integrating data for analysis and migration purposes including data wrangling and analysis activities.
• Understanding of the software development lifecycle and applying software development best practices, including version control (e.g. git), automated testing (e.g. pytest) and CI/CD (e.g. GitHub Actions).
• Experience using infrastructure-as-code approaches to deploy and manage AWS cloud infrastructure.
• Supporting data quality, migration or business intelligence activities through effective data engineering practices.
• Working with technical and non‑technical stakeholders to understand requirements and deliver effective data solutions.
• Experience working in a fast‑paced delivery environment, managing multiple priorities and delivering high‑quality outputs to challenging deadlines.
• Proven ability to proactively manage and maintain data pipelines, ensuring timely and reliable access to data for analytical and operational needs.
• Ability to identify, investigate and resolve data pipeline issues with minimal disruption to programme delivery.

PLEASE NOTE: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position (short‑term nature of this role and speed at which we require a postholder in situ) preference may be given to candidates who meet all of the essential criteria and hold active security clearance.

Desirable:

• Oracle E‑Business Suite (EBS) experience across HR, Finance and Procurement.
• SplashBI experience.
• ERP transformation experience.
• Data migration experience.

Please be aware that this role can only be worked within the UK and not Overseas.

Disability Confident

As a member of the Disability Confident Scheme, MOJ guarantees to interview all candidates who have a disability and who meet all the essential criteria for the vacancy. In cases where we have a high volume of candidates who have a disability who meet all of the essential criteria, we will interview the best candidates from within that group. This scheme encourages candidates with a disability and/or neurodivergence to apply. In exceptional circumstances, we may also need to apply the desirable criteria in our shortlisting process which may include holding active security clearance.

Armed Forces Covenant

The Ministry of Justice guarantees to interview veterans or spouses / partners of military personnel who meet all the essential criteria for the vacancy. In cases where we have a high volume of ex‑military candidates / military spouses or partners, who meet all of the essential criteria, we will interview the best candidates from within that group. In exceptional circumstances, we may also need to apply the desirable criteria in our shortlisting process which may include holding active security clearance.

In applying for this role, you acknowledge the following "this role falls in scope of the Off Payroll Working in the public sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different".