Senior Data Consultant: Secure AWS Pipelines Lead (Hybrid)

Cyber Security training courses

Greater London

Hybrid

GBP 83,000 - 109,000

Full time

14 days+

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Confidential Client in the United Kingdom seeks a Senior Data Consultant to lead the delivery of secure ingestion and integration pipelines, translating Data Architect designs into working capability. This is a technical leadership role combining hands-on delivery oversight, pipeline implementation, test coordination, assurance support and service handover.

You will mentor Data Engineers and drive delivery discipline.

Qualifications

  • Significant experience leading enterprise-scale data engineering or integration programmes.
  • Strong AWS delivery experience with secure engineering practices and observability.
  • Strong Apache NiFi experience with pipelines, processors, controller services and monitoring.
  • Proven experience delivering API integrations, file-based integrations, legacy system interfaces and bespoke data connectors.
  • Experience building secure ETL/ELT pipelines for structured, semi-structured and unstructured data.
  • Experience within MOD, Defence or secure government environments involving different security classifications.
  • Strong understanding of data mapping, schema management, transformation logic, validation, lineage and interface version control.
  • Experience with CI/CD, DevSecOps, source control, automated testing and release management for data platforms.
  • The ability to lead technical teams while remaining hands-on to resolve complex delivery issues.
  • Strong stakeholder management, technical communication and delivery governance skills.

Responsibilities

  • Lead the build, testing, assurance, deployment and handover of secure data pipelines into an AWS data lake.
  • Translate architectural designs into implementation plans, work packages and practical technical delivery approaches.
  • Lead API-based, file-based, legacy and bespoke integrations using Apache NiFi and AWS services.
  • Manage the onboarding of source systems, including interface analysis, data mapping, transformation rules and security considerations.
  • Define and coordinate unit, integration, performance, security and operational acceptance testing.
  • Lead defect triage, manage technical risks and resolve complex integration issues.
  • Ensure pipeline solutions include monitoring, logging, alerting, error handling, retry logic and appropriate operational support procedures.
  • Coordinate evidence for assurance and accreditation activities with cyber security teams and design authorities.
  • Produce technical documentation, runbooks, release notes and service handover materials.
  • Mentor and direct Data Engineers, maintaining technical quality and delivery discipline.

Skills

Enterprise-scale data engineering
AWS delivery
Apache NiFi
APIs & data integrations
ETL/ELT pipelines
MOD/secure environments
Data mapping & lineage
CI/CD / DevSecOps
Stakeholder management
Delivery governance

Tools

AWS
Apache NiFi

Job description

Confidential Client in the United Kingdom seeks a Senior Data Consultant to lead the delivery of secure ingestion and integration pipelines, translating Data Architect designs into working capability. This is a technical leadership role combining hands-on delivery oversight, pipeline implementation, test coordination, assurance support and service handover.

You will mentor Data Engineers and drive delivery discipline.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Principal AWS Data Engineer: Lead Pipelines (Hybrid)
Principal AWS Data Engineer: Lead Pipelines (Hybrid)

Capco • Greater London

Hybrid
GBP 120,000 - 180,000
Discretionary bonus
Competitive pension
Health insurance
+5
Senior Data Engineer: AWS Pipelines Lead & Mentor (Hybrid)
Senior Data Engineer: AWS Pipelines Lead & Mentor (Hybrid)

Center Parcs • Newark on Trent

Hybrid
GBP 60,000 - 65,000
Bonus scheme
Pension & Life Assurance
Free Day Passes
+5
Senior Data Engineer - Azure Data Pipelines | Hybrid, UK Cleared
Senior Data Engineer - Azure Data Pipelines | Hybrid, UK Cleared

Project Freelance • Greater London

Hybrid
GBP 90,000 - 120,000
Private healthcare
Pension
Share scheme (3.5% + 3.5% matching)
Senior Data Engineer - Secure, Scalable Pipelines (Remote)
Senior Data Engineer - Secure, Scalable Pipelines (Remote)

NPAworldwide • Birmingham

Hybrid
GBP 50,000 - 70,000
Flexible working
Hybrid/remote working
Learning & Development
+5
Senior Data Engineer | Hybrid London | Lead Pipelines
Senior Data Engineer | Hybrid London | Lead Pipelines

dcoded. | B Corp ™ • Greater London

Hybrid
GBP 60,000 - 75,000
Hybrid working with flexible remote
9am–6pm working hours
Senior DataOps Engineer — Cloud Data Pipelines & Governance
Senior DataOps Engineer — Cloud Data Pipelines & Governance

SF Partners • Newcastle upon Tyne

Hybrid
GBP 70,000 - 110,000
Senior DataOps Engineer: Cloud Pipelines (Hybrid)
Senior DataOps Engineer: Cloud Pipelines (Hybrid)

Alfa AI • Bristol

Hybrid
GBP 70,000 - 120,000
Senior Data Engineer: AWS Pipelines, Lead & Hybrid Role
Senior Data Engineer: AWS Pipelines, Lead & Hybrid Role

Center Parcs • Newark and Sherwood

Hybrid
GBP 60,000 - 65,000
Bonus scheme
Pension
Recognition & rewards
+6
Data Engineer — Secure ETL Pipelines (London Hybrid)
Data Engineer — Secure ETL Pipelines (London Hybrid)

Marks and Spencer • City Of London

Hybrid
GBP 65,000 - 90,000
Senior Data Engineer — Cloud Pipelines & Data Quality
Senior Data Engineer — Cloud Pipelines & Data Quality

Solirius Reply • England

On-site
GBP 50,000 - 70,000
Bonus Scheme
25 Days Annual Leave + Bank Holidays
Flexible Working
+1