Data & Integration Engineer - AI

HMRC

United Kingdom

Presencial

GBP 92 000 - 148 000

Tempo integral

Há 3 dias
Torna-te num dos primeiros candidatos

Uma candidatura completa num minuto

Currículo e carta de apresentação personalizados, prontos a enviar.

Ultrapassa os filtros ATS

Resumo da oferta

HMRC is seeking a Data and Integration Engineer - AI for a 6-12 month contract across the United Kingdom. You will assess data readiness, build pipelines, APIs and integration patterns to support AI propositions.

You will work with data owners, architects, AI engineers, cyber security and service teams to ensure data lineage, permissions, quality and reliable operation of AI components.

Qualificações

  • Experience in AI engineering.
  • Proven data engineering for ingestion, transformation, processing pipelines across structured and unstructured data.
  • Experience designing APIs and system integrations with authentication, error handling, versioning and monitoring.
  • Hands-on with retrieval tech for AI (embeddings, vector databases, hybrid search).
  • Proficient in Python, SQL; modern engineering practices (CI/CD, testing).
  • Strong data governance, metadata, lineage in regulated environments.
  • Security, privacy and access controls for sensitive data; integrate with secret managers.
  • Ability to assess data readiness and explain constraints to teams.

Responsabilidades

  • Assess data readiness, quality, ownership, permissions and accessibility of data and knowledge sources.
  • Define data contracts, schemas, metadata, lineage and validation rules for AI use cases.
  • Build ingestion and transformation pipelines for structured, semi-structured and unstructured content.
  • Develop secure APIs, events, connectors and integration services linking AI components to operational systems.
  • Implement retrieval pipelines including parsing, chunking, enrichment, embeddings, indexing, vector search, filtering and ranking.
  • Apply data minimisation, retention, access control, audit and privacy requirements throughout the engineering lifecycle.
  • Automate testing and monitoring for data quality, freshness, pipeline reliability and service performance.
  • Diagnose and resolve data, interface and retrieval issues across distributed systems.
  • Create reusable patterns, code, documentation and deployment guidance for other teams.
  • Support handover to platform, product and service teams with runbooks and ownership.

Conhecimentos

AI engineering
Data integration
Pipelines design
Data quality
Data governance
Python
SQL

Ferramentas

APIs
Vector databases
CI/CD

Descrição da oferta de emprego

Data and Integration Engineer - AI

6-12 month contract (dependent on business need)

Any HMRC Regional Centre across the United Kingdom

Competitive Day Rate

Role overview

Assess data readiness and access, connect trusted knowledge sources and operational systems, and develop the pipelines, APIs, retrieval and integration patterns required by AI propositions.

Job description

You will provide the data and integration engineering that enables AI propositions to use reliable, authorised and well-governed information. You will assess candidate data and knowledge sources, resolve access and quality issues, and build secure connections between AI components and enterprise systems.

You will create repeatable ingestion, transformation, retrieval and API patterns that support prototypes while providing a credible route to scale and live operation. You will work closely with data owners, architects, AI engineers, cyber security and service teams to ensure lineage, permissions, quality and operational responsibilities are understood.

  • Assess the readiness, quality, ownership, sensitivity, permissions and technical accessibility of data and knowledge sources.
  • Define data contracts, schemas, metadata, lineage and validation rules for AI use cases.
  • Build and maintain ingestion and transformation pipelines for structured, semi-structured and unstructured content.
  • Develop secure APIs, events, connectors and integration services linking AI components to operational systems.
  • Implement retrieval pipelines including parsing, chunking, enrichment, embeddings, indexing, vector search, filtering and ranking.
  • Apply data minimisation, retention, access control, audit and privacy requirements throughout the engineering lifecycle.
  • Automate testing and monitoring for data quality, freshness, pipeline reliability, integration failures and service performance.
  • Diagnose and resolve data, interface and retrieval issues across distributed systems.
  • Create reusable patterns, code, documentation and deployment guidance for other teams.
  • Support handover to platform, product and service teams, including runbooks, ownership, support and change arrangements.
Person specification

A senior data engineer with strong integration skills and a practical understanding of how data quality, access control and retrieval affect AI outcomes. You will be comfortable exploring unfamiliar data estates, designing robust pipelines and APIs, and communicating constraints and options to both technical teams and data owners.

Essential criteria

The successful contractor will be able to demonstrate the following essential experience and capability:

  • Experience in AI engineering.
  • Proven data engineering experience designing and operating ingestion, transformation and processing pipelines across structured and unstructured data.
  • Strong experience designing and implementing APIs and system integrations, including authentication, error handling, versioning and monitoring.
  • Hands-on experience with retrieval technologies for AI, such as document processing, embeddings, vector databases, hybrid search, metadata filtering or ranking.
  • Experience using Python, SQL and modern engineering practices including source control, automated testing and continuous integration and delivery.
  • Strong understanding of data modelling, data quality, metadata, lineage and data governance in a large or regulated organisation.
  • Experience implementing security, privacy and access controls for sensitive data and integrating with enterprise identity and secrets-management services.
  • Ability to assess data readiness, explain constraints and trade-offs, and work effectively with data owners, architects, engineers and operational teams.
Obtém a tua avaliação gratuita e confidencial do currículo.

ou arrasta e larga o ficheiro aqui.

Similar jobs

Ofertas semelhantes que vale a pena comparar

Data Engineer (AI) - Until end of April - Inside IR35 - Remote
Data Engineer (AI) - Until end of April - Inside IR35 - Remote

Morson Group • Grã-Bretanha

Teletrabalho
GBP 158 000 - 207 000
AI Data Integration Engineer - Secure Pipelines & APIs
AI Data Integration Engineer - Secure Pipelines & APIs

HMRC • Grã-Bretanha

Presencial
GBP 92 000 - 148 000
Senior Data Engineer
Senior Data Engineer

ByteHire Limited. • Grã-Bretanha

Teletrabalho
GBP 90 000 - 130 000
Data & AI Engineer
Data & AI Engineer

Digi2al Limited • Portsmouth

Presencial
GBP 112 000 - 147 000
Solution Architect - AI
Solution Architect - AI

HMRC • Grã-Bretanha

Presencial
GBP 111 000 - 166 000
Senior AI Agent Engineer for Prototyping & Scale
Senior AI Agent Engineer for Prototyping & Scale

HMRC • Grã-Bretanha

Teletrabalho
GBP 92 000 - 166 000
AI Engineer
AI Engineer

Y-Axis • Greater London

Presencial
GBP 45 000 - 95 000
15% clearance bonus
Data & AI Engineer
Data & AI Engineer

Digi2al • Portsmouth

Presencial
GBP 112 000 - 147 000
Data Architect | AI & Data Engineering
Data Architect | AI & Data Engineering

Ncounter • Grã-Bretanha

Híbrido
GBP 70 000 - 90 000
Data Engineer (AI & Software)
Data Engineer (AI & Software)

Mobilise Cloud Services Ltd • Winchester

Híbrido
GBP 70 000 - 100 000
Hybrid working model (50% home, 50%-30
Competitive salary
Career development support (AWS Azure,