Senior Data Engineer – 15618

Comxps Ltd; United Kingdom; Remote; GBP 70,000 - 100,000; Full time

Job summary

Comxps Ltd. is seeking a senior Data Engineering professional for a Government Client engagement. Remote UK-based role focusing on scalable data pipelines, API integrations, and retrieval systems for enterprise AI architectures.

You will apply AWS, Python, and SQL expertise to build robust data platforms, implement CI/CD with Terraform, ensure data governance and GDPR compliance, and lead cross-functional teams in an agile setting.

Qualifications

• Hands-on experience building scalable data pipelines (ETL/ELT).
• Expert knowledge of data governance, security & UK GDPR/DPA compliance.

Skills

ETL/ELT pipelines

API integrations

Vector indices / retrieval systems

AWS

Python

SQL

Identity & access management

GDPR / UK data compliance

CI/CD

Terraform

Data governance

Tools

Terraform

CI/CD tools

Job description

Salary: £To be confirmed on application (our client has asked for this not to be advertised).

Location: Remote

Contracting Authority: Government Client
Contract Length: Until 30/04/27
Clearance: SC

Essential Criteria (Skills, Knowledge & Experience)

• Technical Mastery & Engineering Practice: Hands-on expertise in building scalable ETL/ELT pipelines, designing robust API integrations, and configuring vector indices or retrieval systems for large-scale enterprise AI architectures.
• Data Governance, Security & Compliance: Expert knowledge of Identity and Access Management, identity federation, data classification standards, and UK GDPR/DPA compliance frameworks within AI environments.
• Analytical Proficiency & Data Diagnostics: Substantial experience conducting quantitative data quality assessments, structuring synthetic testing environments, and evaluating dataset readiness for complex automation or ML models.
• Languages & Software Engineering Standards: Advanced proficiency in AWS, Python, SQL, and query optimisation, alongside demonstrated experience implementing CI/CD pipelines using Terraform, automated testing, and metadata management best practices.
• Strategic Communication & Leadership: Proven ability to translate complex technical data risks into strategic guidance for senior leadership, alongside a track record of leading cross-functional engineering teams in agile environments.

Our dedicated team would be pleased to discuss in more detail how we may be able to help