AWS Data Engineer (PySpark/AI) - Hybrid London

Datatech Analytics

City Of London

Hybrid

GBP 45,000 - 75,000

Full time

6 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Datatech Analytics is seeking an AWS Data Engineer to own and evolve data products in a hybrid London-based role. You will design and optimise ETL/ELT pipelines, expand the AWS data lake, and partner with product and engineering to structure data for scalable analytics.

You will work with large event data, enhance data quality, and contribute to CI/CD improvements while exploring new technologies and Claude Code-enabled workflows.

Qualifications

  • Strong SQL for transforming, cleaning and loading data.
  • Commercial Python, PySpark and Pandas experience.
  • Experience with orchestration tools such as Airflow, Dagster or Celery.
  • Practical experience with Spark and EMR Hands-on knowledge of AWS services, including Lambda, RDS and S3.
  • Experience using Claude Code as part of your day-to-day engineering workflow.
  • An understanding of CI/CD and DataOps practices.
  • Strong communication skills and the ability to collaborate with colleagues internationally.

Responsibilities

  • Build and improve ETL and ELT pipelines supporting analytics and customer-facing products.
  • Expand and optimise the existing AWS data lake and architecture.
  • Work closely with product and engineering teams to shape how data is structured and used.
  • Improve data quality, accessibility and reliability across the platform.
  • Automate manual processes and strengthen CI/CD across data workflows.
  • Explore new technologies and influence future engineering decisions.
  • Use Claude Code to support development, debugging, testing and documentation.

Skills

SQL
Python
PySpark
Pandas
Claude Code
DataOps
CI/CD
Communication
Cross-team collaboration

Tools

Airflow
Dagster
Celery
Spark
EMR
Lambda
S3
RDS

Job description

Datatech Analytics is seeking an AWS Data Engineer to own and evolve data products in a hybrid London-based role. You will design and optimise ETL/ELT pipelines, expand the AWS data lake, and partner with product and engineering to structure data for scalable analytics.

You will work with large event data, enhance data quality, and contribute to CI/CD improvements while exploring new technologies and Claude Code-enabled workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AWS Data Engineer — Hybrid London, Build Scalable Pipelines
AWS Data Engineer — Hybrid London, Build Scalable Pipelines

Datatech Analytics • Greater London

Hybrid
GBP 45,000 - 75,000
AWS Data Engineer - PySpark/AI
AWS Data Engineer - PySpark/AI

Datatech Analytics • City Of London

Hybrid
GBP 45,000 - 75,000
Data Engineer - AWS, PySpark & AI Impact
Data Engineer - AWS, PySpark & AI Impact

Datatech Analytics • City of Westminster

On-site
GBP 60,000 - 90,000
AWS Data Engineer - PySpark/AI
AWS Data Engineer - PySpark/AI

Datatech Analytics • City of Westminster

On-site
GBP 60,000 - 90,000
AWS Data Engineer - Lakehouse & PySpark (Essex, Onsite)
AWS Data Engineer - Lakehouse & PySpark (Essex, Onsite)

Red Sap Solutions • Great Holland

On-site
GBP 60,000 - 90,000
Cloud Data Engineer: Spark, Airflow & AWS | Hybrid UK
Cloud Data Engineer: Spark, Airflow & AWS | Hybrid UK

Scrumconnect Limited • Newcastle upon Tyne

Hybrid
GBP 70,000 - 95,000
AWS Data Engineer
AWS Data Engineer

Technopride Ltd • Greater London

On-site
GBP 75,000 - 95,000
AWS Data Engineer
AWS Data Engineer

RED Global • Basildon

On-site
GBP 65,000 - 90,000
AWS Data Engineer
AWS Data Engineer

Datatech Analytics • Greater London

Hybrid
GBP 45,000 - 75,000
AWS Data Engineer
AWS Data Engineer

Red Commerce Schweiz GmbH • Essex

On-site
GBP 92,000 - 120,000