AWS Data Engineer — Glue & PySpark Migration Specialist

Opus Recruitment Solutions Ltd; Greater London; Híbrido; GBP 92.000 - 97.000; Jornada completa

Descripción de la vacante

Opus Recruitment Solutions Ltd in the United Kingdom is seeking a hands-on AWS Data Engineer for a migration project. This urgent contract will move a large Ab Initio ETL estate to a modern, serverless AWS data platform.

You will define migration patterns and deliver production-ready AWS Glue solutions, working with PySpark, Python, SQL and Spark tuning on large-scale pipelines. The role offers remote-first arrangements with occasional on-site London presence.

Formación

• Strong AWS Data Engineer, ideally AWS Certified.
• Proven experience delivering Ab Initio to AWS Glue (PySpark) migrations.
• Hands-on AWS Data Engineering with AWS Glue, S3, Athena and serverless platforms.
• Advanced Python, PySpark and SQL skills.
• Experience converting Ab Initio transformations into scalable PySpark solutions.
• Experience building and optimizing large-scale ETL/data pipelines in AWS.
• Spark performance tuning and data skew troubleshooting.

Responsabilidades

• Define migration patterns and migration strategy for Ab Initio estate.
• Develop production-ready AWS Glue solutions for the target data platform.
• Build and optimize large-scale ETL pipelines in AWS.
• Tune Spark jobs to improve performance and reduce memory/load issues.
• Collaborate with cloud and data teams in a financial services context.

Conocimientos

AWS Data Engineer

PySpark

Python

SQL

Spark

ETL

Data Warehousing

Data Modelling

Ab Initio experience

Herramientas

AWS Glue

S3

Athena

Airflow (MWAA)

Descripción del empleo

Opus Recruitment Solutions Ltd in the United Kingdom is seeking a hands-on AWS Data Engineer for a migration project. This urgent contract will move a large Ab Initio ETL estate to a modern, serverless AWS data platform.

You will define migration patterns and deliver production-ready AWS Glue solutions, working with PySpark, Python, SQL and Spark tuning on large-scale pipelines. The role offers remote-first arrangements with occasional on-site London presence.