Senior Technical Lead

Luxoft; Greater London; On-site; GBP 48,000 - 68,000; Full time

Job summary

Luxoft in London is seeking a senior data engineer / migration architect to lead the migration of the client’s ETL estate from Matillion to AWS Glue. You will define the target-state architecture across compute, data, and orchestration, and produce high-/low-level designs for migration workloads.

The role requires 5+ years, deep AWS data stack experience, Terraform IaC, PySpark, and CI/CD for data pipelines, with English at C2. Based in London within Strategy & Design Consulting.

Qualifications

• 5+ years of professional experience in data engineering and migration.
• Hands-on AWS migration experience with Glue, Step Functions, Lambda and EventBridge.
• Strong IaC skills with Terraform and architecture as code.
• Proven track record architecting data platforms at scale (data lakes/warehouses).
• PySpark experience for large-scale data processing.
• CI/CD pipelines for infra and data workflows; GitHub Copilot usage.
• English proficiency at C2 level; senior-level expertise.
• Nice-to-have: BI tools experience (Power BI/Tableau/ QuickSight).
• Nice-to-have: Terraform or CloudFormation experience; financial domain exposure.

Responsibilities

• Define and own target-state AWS architecture across compute, data, and orchestration.
• Produce and own High-Level and Low-Level designs for migration workloads.
• Present architecture proposals to Architecture Review Board for approval.
• Document key technical decisions balancing cost, performance, and scalability.
• Define reusable architecture and migration patterns for multiple teams.
• Design architecture for Agentic AI migration framework and integration.

Skills

AWS migration

AWS Glue

Step Functions

Lambda

EventBridge

Terraform

PySpark

CI/CD pipelines

GitHub Copilot

English Proficiency C2

Tools

Power BI

Tableau

QuickSight

GitHub

Job description

Salary: £48,000 - 68,000 per year

Requirements

• We require 5+ years of experience.
• We require hands-on experience with AWS migration.
• We require deep hands-on experience with AWS Glue, Step Functions, Lambda, and EventBridge.
• We require strong experience defining and managing infrastructure as code with Terraform.
• We require proven experience architecting data platforms at scale, including data lakes, warehouses, and pipelines.
• We require hands-on experience with PySpark for large-scale data processing.
• We require experience designing and implementing CI/CD pipelines for infrastructure and data workflows.
• We require working knowledge of AI/ML frameworks and their application within architecture design.
• We require practical experience using GitHub Copilot within development and architecture workflows.
• We require English proficiency at C2 level.
• We require senior-level experience.
• Nice to have: AWS certification such as Data Analytics Specialty or Solutions Architect.
• Nice to have: Experience with BI tools such as QuickSight, Tableau, or Power BI.
• Nice to have: Terraform or CloudFormation experience.
• Nice to have: Industry experience relevant to our business.
• Nice to have: Exposure to streaming data such as Kinesis or ML pipelines such as SageMaker.
• Nice to have: Experience in the financial domain.

Responsibilities

• We define and own the target-state AWS architecture across compute, data, and orchestration layers.
• We produce and own High-Level Design and Low-Level Design documentation for migration workloads.
• We prepare and present architecture proposals to the Architecture Review Board for approval.
• We make and document key technical decisions across the migration program, balancing cost, performance, and scalability.
• We define reusable architecture and migration patterns for use across teams and pods.
• We design the architecture for the Agentic AI migration framework and its integration with the broader technical landscape.

Technologies

• Agentic AI
• AI
• AWS
• AWS Glue
• Lambda
• Architect
• CI/CD
• Copilot
• ETL
• GitHub
• Power BI
• PySpark
• Tableau
• Terraform
• Cloud
• DevOps
• VR

More

This is a strategic data engineering engagement with our client to architect and plan the migration of their entire data processing and ETL estate from Matillion to AWS Glue. During the Mobilisation Phase, we work jointly with engineering teams to reverse-engineer the existing landscape, design the target-state architecture across infrastructure, data processing, workflows, dependencies, and operating model, and build the detailed delivery blueprint that will greenlight the full-scale migration. The work is technically rich and highly collaborative, including review and validation of job inventories spanning hundreds of ETL workflows, definition of reusable migration patterns and templates, design of a validation and reconciliation framework, a proof-of-concept to stress-test the approach, and navigation of rigorous internal governance through Architectural Significance Assessments, Architectural Review Boards, and a formal Gate 1 decision. The role is based in London, United Kingdom, within our Strategy & Design Consulting (SI) team, supporting the BCM industry.

last updated 36 week of 2026