AWS Data Platform Architect — ETL & Migration Lead

Luxoft; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

Luxoft in London is delivering a strategic data engineering engagement to migrate the client’s ETL estate from Matillion to AWS Glue. You’ll reverse‑engineer the current landscape, design the target architecture, and build a detailed delivery blueprint to govern a multi‑million‑pound migration in a Tier 1 financial services environment.

You’ll design and migrate pipelines to AWS, implement governance and security, optimize costs, and collaborate with engineering teams, data analysts, and

Qualifications

• 5+ years of experience in data engineering or similar.
• Hands-on experience building data pipelines on AWS (Glue, EMR, Lambda, Step Functions).
• Strong SQL and data warehousing experience (Redshift, dimensional modeling).
• Proficiency in Python or Scala for data engineering tasks.
• Experience with S3-based data lake architectures (partitioning, cataloging, Parquet).
• Experience migrating data pipelines from on-prem or other cloud platforms.
• Understanding of AWS data governance, security, and access control.
• Experience with CI/CD for data pipelines.

Responsibilities

• Design, build, and maintain ETL/ELT pipelines on AWS
• Migrate existing data pipelines and workloads from legacy/on-prem systems to AWS
• Develop and optimize data models for data warehouse/data lake (Redshift, S3)
• Build and orchestrate data workflows (Glue, Step Functions, Lambda, EMR)
• Implement data quality checks, validation, and reconciliation processes
• Optimize pipeline performance and manage compute/storage costs
• Ensure data security and access control (IAM, KMS, encryption)
• Monitor and troubleshoot pipeline failures (CloudWatch, logging)
• Collaborate with data analysts, BI developers, and architects on data requirements
• Document data pipelines, architecture, and operational runbooks

Skills

5+ years experience

AWS data pipelines

SQL and data warehousing

Python or Scala

S3 data lake architecture

Pipelines migration experience

AWS governance and security

CI/CD for data pipelines

Tools

AWS Glue

AWS EMR

AWS Lambda

AWS Step Functions

Amazon S3

Terraform

CloudFormation

Airflow

dbt

Kafka/Kinesis

Job description

Luxoft in London is delivering a strategic data engineering engagement to migrate the client’s ETL estate from Matillion to AWS Glue. You’ll reverse‑engineer the current landscape, design the target architecture, and build a detailed delivery blueprint to govern a multi‑million‑pound migration in a Tier 1 financial services environment.

You’ll design and migrate pipelines to AWS, implement governance and security, optimize costs, and collaborate with engineering teams, data analysts, and