Senior Data Engineer: Scalable Pipelines & Data Quality

Government Recruitment Service; West of England; On-site; GBP 45,000 - 60,000; Full time

Job summary

A government agency in the UK is seeking a data engineer to build and optimise ETL and streaming pipelines for large datasets. The role involves ensuring data quality, security, and compliance while collaborating with analysts and product teams. Ideal candidates will have extensive experience in data engineering, including the automation of deployment processes. This position offers the chance to work on impactful data solutions within government operations.

Qualifications

• Experience in designing scalable data pipelines.
• Familiarity with cloud storage solutions.
• Understanding of data quality standards.

Responsibilities

• Design and operate ETL and streaming pipelines.
• Enforce data modelling and quality standards.
• Automate deployment and monitoring processes.

Skills

ETL design and implementation

Data quality assurance

Automation tools (CI/CD)

Cloud platform experience

Data security compliance

Tools

APIs

Database management systems

Job description

A government agency in the UK is seeking a data engineer to build and optimise ETL and streaming pipelines for large datasets. The role involves ensuring data quality, security, and compliance while collaborating with analysts and product teams. Ideal candidates will have extensive experience in data engineering, including the automation of deployment processes. This position offers the chance to work on impactful data solutions within government operations.