Data Engineer

Synergize Consulting; England; On-site; GBP 60,000 - 100,000; Full time

Job summary

Synergize Consulting is seeking a Data Engineer to work on a contract basis for a leading consultancy client. You will develop secure, scalable data pipelines to enable data processing and downstream analysis for a public sector body.

Responsibilities include designing ETL/ELT pipelines, transforming data, handling XML/JSON, and ensuring data quality in secure environments. Experience with SCC/NPPV3 clearance is advantageous.

Qualifications

• Solid background in data engineering and pipeline development.
• Experience developing ETL/ELT, ingestion or data integration pipelines.
• Experience with XML and JSON data formats.

Responsibilities

• Design, develop and maintain data ingestion and ETL/ELT pipelines.
• Profile, transform and validate structured and semi-structured data.
• Work with XML and JSON data and develop mapping and transformation processes.
• Implement data conversion and integration routes between systems.
• Develop and support data pipelines within secure environments.
• Create synthetic data to support testing and integration activities.
• Build automation to improve data processing and engineering workflows.
• Support testing and validation of data pipelines and integrations.

Skills

Data engineering

ETL/ELT pipelines

XML/JSON data

Elasticsearch

Kibana

Cross-functional collaboration

Security awareness

Tools

Elasticsearch

Kibana

Job description

Synergize Consulting are now hiring for a Data Engineer to work at a leading consultancy client on a contract basis.

The successful candidate will support the development of secure, scalable and reliable data engineering solutions within a complex operational environment on behalf of a public sector body, working on pipelines that enable data to be securely processed, mapped and made available for downstream analysis and intelligence use.

Responsibilities include:

• Designing, developing and maintaining data ingestion and ETL/ELT pipelines.
• Profiling, transforming and validating structured and semi-structured data.
• Working with XML and JSON data and developing schema mapping and transformation processes.
• Implementing data conversion and integration routes to support the movement of data between systems.
• Developing and supporting data pipelines within secure environments.
• Developing synthetic data to support testing, development and integration activities.
• Building automation to improve data processing and engineering workflows.
• Supporting the testing and validation of data pipelines and integrations.

Experience required:

• A solid background in data engineering and pipeline development.
• Experience developing ETL/ELT, ingestion or data integration pipelines.
• Experience with data transformation, including XML and JSON.
• Experience with Elasticsearch and/or Kibana.
• Previous experience of working within a highly regulated environment, for example the public sector or areas of law enforcement.
• Understanding of data profiling, validation and quality.
• Experience implementing data ingestion, conversion and integration processes.
• Experience supporting testing and development through synthetic data generation.
• Ability to work effectively across technical and operational teams.
• Strong communication skills, both written and verbal
• Due to the nature of the client, it would be an advantage for candidates to hold, or be eligible and willing to undergo, a certain level of security clearance (SC / NPPV3)