AWS Data Engineer – Hybrid London, Scalable Pipelines

FalconSmartIT; Greater London; Hybrid; GBP 70,000 - 110,000; Full time

Job summary

FalconSmartIT in London is seeking an AWS Data Engineer to design and build scalable data pipelines using Python and Apache Spark, with hybrid work in mind.

You will orchestrate data workflows using AWS Glue, EMR Serverless, Lambda and S3, integrate lakehouse architecture with Apache Iceberg, and collaborate with business teams.

The role emphasizes modern software practices, observability, testing with pytest, CI/CD, and active participation in code reviews and architecture discussions.

Qualifications

• Experience building scalable data pipelines in Python and Spark.
• Strong Python and Spark/ PySpark skills with a functional mindset.
• Familiarity with AWS data services and lakehouse architectures.
• Ability to translate business requirements into data-driven solutions.

Responsibilities

• Design scalable, testable data pipelines in Python and Spark.
• Orchestrate data workflows with AWS tools.
• Contribute to lakehouse architecture using Apache Iceberg.
• Collaborate with stakeholders in Agile teams and reviews.
• Build observability and basic quality checks into data flows.
• Participate in code reviews and architecture discussions.

Skills

Python

PySpark

AWS

Data pipelines

CI/CD

Testing (pytest)

Type hints

Agile

Observability

Spark

ETL

Tools

AWS Glue

EMR Serverless

Lambda

S3

GitLab CI

Jenkins

GitHub Actions

Apache Iceberg

Job description

FalconSmartIT in London is seeking an AWS Data Engineer to design and build scalable data pipelines using Python and Apache Spark, with hybrid work in mind.

You will orchestrate data workflows using AWS Glue, EMR Serverless, Lambda and S3, integrate lakehouse architecture with Apache Iceberg, and collaborate with business teams.

The role emphasizes modern software practices, observability, testing with pytest, CI/CD, and active participation in code reviews and architecture discussions.