Senior Data Engineer – 15618

Comxps Ltd; United Kingdom; Remote; GBP 60,000 - 90,000; Full time

Job summary

Comxps Ltd seeks a senior data engineering lead for a remote UK role supporting a Government client. You will design scalable ETL/ELT pipelines, build robust API integrations, and configure vector indices for enterprise AI systems.

Security, governance, and compliance with UK GDPR/DPA are essential as you lead cross-functional engineering teams in an Agile setting. You will work with AWS, Python, and SQL, implement Terraform-based CI/CD, and translate complex data risks into strategic guidance

Qualifications

• Hands-on experience building scalable ETL/ELT pipelines.
• Expert in API integrations for large-scale AI architectures.
• Strong knowledge of IAM, data classification, UK GDPR/DPA.
• Proficient in AWS, Python, SQL and query optimization.
• Experience with Terraform, automated testing, and CI/CD.
• Ability to translate technical risks to senior leadership and lead cross-functional teams in Agile.

Skills

ETL/ELT pipelines

API integrations

Vector indices retrieval systems

AWS

Python

SQL

CI/CD pipelines

Agile leadership

Data governance & GDPR

Security & IAM

Tools

Terraform

CI/CD tooling

Job description

Salary: £To be confirmed on application (our client has asked for this not to be advertised).

Location: Remote

Contracting Authority: Government Client
Contract Length: Until 30/04/27
Clearance: SC

Essential Criteria (Skills, Knowledge & Experience)

• Technical Mastery & Engineering Practice: Hands-on expertise in building scalable ETL/ELT pipelines, designing robust API integrations, and configuring vector indices or retrieval systems for large-scale enterprise AI architectures.
• Data Governance, Security & Compliance: Expert knowledge of Identity and Access Management, identity federation, data classification standards, and UK GDPR/DPA compliance frameworks within AI environments.
• Analytical Proficiency & Data Diagnostics: Substantial experience conducting quantitative data quality assessments, structuring synthetic testing environments, and evaluating dataset readiness for complex automation or ML models.
• Languages & Software Engineering Standards: Advanced proficiency in AWS, Python, SQL, and query optimisation, alongside demonstrated experience implementing CI/CD pipelines using Terraform, automated testing, and metadata management best practices.
• Strategic Communication & Leadership: Proven ability to translate complex technical data risks into strategic guidance for senior leadership, alongside a track record of leading cross-functional engineering teams in agile environments.

Our dedicated team would be pleased to discuss in more detail how we may be able to help