Data Engineer

Public Sector Resourcing, managed by AMS; United Kingdom; Remote; GBP 60,000 - 80,000; Full time

Job summary

A government agency in the UK is seeking a Data Engineer for a 6-month remote contract, requiring SC Clearance. The role involves developing data products, writing ETL scripts, and ensuring data quality for community services reporting. Ideal candidates will have strong programming and data management skills, along with compliance to UK GDPR.

Qualifications

• Proficient in shell scripting and command-line tools.
• Ability to design, build and test data products.
• Skilled in programming and database management.

Responsibilities

• Develop and construct data products and services.
• Implement data flows to connect operational systems.
• Write ETL scripts for optimal performance.

Skills

Data profiling

Shel scripting

Programming skills

Database management

ETL processes

UK GDPR compliance

Job description

Overview

On behalf of The Ministry of Justice, we are looking for a Data Engineer (Inside IR35) for a 6 Month Remote contract with occasional visits to London, Manchester, Birmingham or Leeds.

Note: SC Clearance is an essential requirement for this role, as a minimum you must be willing & eligible to undergo checks. Please note, due to the exceptional requirements of this position, (and speed at which we require a postholder in situ), preference may be given to candidates who meet all of the essential criteria and hold active security clearance.

Role specifics

The main focus of this work will be to process probation systems-based data for contract reporting and performance monitoring of commissioned community services on a quarterly basis.

You will be required to build an automated process that enables data to be linked, cleansed at a national level, and tables (with calculations where appropriate) for reports populated on an individual service level. Tables are incorporated into an editable reporting template for each service (approximately 75 reports pertaining to two distinct types of service). A data quality monitoring and feedback process for services would also need to be incorporated into the reporting process.

You will be required to write an automatable script to allow this reporting process to be implemented quarterly. To allow amendments and updates to be made as and when necessary to ensure prolonged usability of this script, you will be required to provide guidance to colleagues on relevant factors. Data quality assurance and completeness checks on a national level will also form part of the build mechanics.

Responsibilities

• Develop and construct data products and services and integrate them into systems and business processes.
• Deliver the designs set by more senior members of the team.
• Implement data flows to connect operational systems, data for analytics and business intelligence (BI) systems.
• Document source-to-target mappings; re-engineer manual data flows to enable scaling and repeatable use; support the build of data streaming systems; write ETL scripts and code to make sure the ETL process performs optimally; develop business intelligence reports that can be re-used; build accessible data for analysis.

Skills and Qualifications

• Undertake data profiling and source system analysis and present clear insights to support the end use of the data.
• Design, build and test data products based on feeds from multiple systems using a range of different storage technologies and/or access methods.
• Produce, maintain and update relevant data models for specific business needs.
• Reverse-engineer data models from a live system.
• Work with metadata repositories to complete complex tasks such as data and systems integration; impact analysis; maintain a repository to ensure information remains accurate and up to date.
• Design, code, test, correct and document simple programs or scripts under direction.
• Proficiency in shell scripting and command-line tools.
• Programming and database management skills and associated languages.
• ETL processes.
• Compliant with UK GDPR.

This work will require an automated process that enables data to be linked, cleansed at a national level, and tables (with calculations where appropriate) for reports populated on an individual service level. These tables would then need to be transposed into a reporting template for each service and the process repeated on a quarterly basis. You will be required to generate an automatable script to allow the above processes to be implemented quarterly. You will also be required to advise other analytical members of the team on the processes required to update and amend scripts as necessary.

Please be aware that this role can only be worked within the UK and not Overseas.

In applying for this role, you acknowledge the following: this role falls in scope of the Off Payroll Working in the Public Sector legislation. Any rates of payment quoted will reflect the gross rate per day for the assignment and will be subject to appropriate taxes and statutory costs. As such the payment to the intermediary and your income resulting from this contract will be different.