Data Engineer

Sanderson Government & Defence; Remote; GBP 50,000 - 70,000; Full time

Job summary

A leading data solutions provider in the United Kingdom is looking for a skilled Data Engineer to develop and manage data pipelines. This includes integrating data from various sources, ensuring quality and consistency while designing ETL processes. Candidates should be proficient in tools like Apache Kafka and NiFI. The role also requires implementing data security measures. Eligibility for DV Clearance is a must for this position.

Qualifications

• Experience in data pipeline development and orchestration.
• Strong understanding of database schema design and modelling.
• Capability in integrating and enriching data from multiple sources.

Responsibilities

• Design and implement data ingestion and pipeline orchestration.
• Manage database schema design and modelling.
• Integrate and ensure data consistency from various sources.
• Design and code ETL processes for data handling.
• Maintain existing architectural components and investigate issues.
• Implement data security measures for sensitive information.
• Monitor data systems for performance and updates.

Skills

Apache Kafka

Apache NiFI

SQL and noSQL databases

ETL processing languages

Job description

Sanderson are currently working with a client who are looking to develop their data engineering capability, this involves working on mission critical solutions that focuses on data services for their customers. You will be managing and developing data pipelines that transforms raw data, enabling downstream analytics.

You will be responsible for

• Data pipeline development - Data ingestion and pipeline orchestration design and tooling.
• Database schema design / database modelling
• Data integration - Integrating and enriching data from various sources, ensuring data consistency and quality.
• ETL processing design and coding - Extract transform and load processing
• Maintain and develop existing architectural components
• Work as part of an operational team investigating and diagnosing problems identified with integrated data.
• Data security - Implementing data security measures to protect sensitive information.
• Monitor and maintain - Monitor data systems for performance issues and make any necessary updates.

Required Skills

• Apache Kafka
• Apache NiFI
• SQL and noSQL databases
• ETL processing languages

This role will require eligibility to be clearable to DV Clearance.

If you're interested in the above, apply or reach out to [e-mail]

Reasonable Adjustments:

Respect and equality are core values to us. We are proud of the diverse and inclusive community we have built, and we welcome applications from people of all backgrounds and perspectives. Our success is driven by our people, united by the spirit of partnership to deliver the best resourcing solutions for our clients.

If you need any help or adjustments during the recruitment process for any reason, please let us know when you apply or talk to the recruiters directly so we can support you.