AWS Data Engineer — Build Secure, Scalable Pipelines

UBDS Digital; Greater London; On-site; GBP 60,000 - 80,000; Full time

Benefits offered by this job

Private medical cover

Discretionary bonus

25 days holiday

Electric Vehicle leasing

Contributed Pension Scheme

Job summary

UBDS Digital in Greater London is looking for skilled AWS Data Engineers to design, build, and maintain scalable data pipelines. Candidates should be proficient in Python, SQL, and AWS services.

The role includes containerisation with Docker and collaboration with cross-functional teams to ensure robust data infrastructure is delivered. Attractive benefits include private medical cover, 25 days holiday plus additional leave, and a discretionary bonus.

Qualifications

• Strong programming skills in Python and proficiency in SQL.
• Experience with Apache Airflow for DAG orchestration and monitoring.
• Hands-on experience with Docker for containerisation.
• Proficient in AWS data services: Redshift, OpenSearch, Lambda, Glue.
• Familiarity with CI/CD pipelines and YAML-based configuration.

Responsibilities

• Develop and maintain data pipelines using Python, SQL, and Apache Airflow.
• Containerise data applications and workflows using Docker.
• Build and optimise data solutions using AWS services.
• Collaborate with cross-functional teams to deliver data infrastructure.
• Monitor and troubleshoot data pipeline performance.

Skills

Python

SQL

Apache Airflow

Docker

AWS services (Redshift, OpenSearch, etc.)

GitLab

CI/CD pipelines

Tools

Git

Terraform

Confluence

Job description

UBDS Digital in Greater London is looking for skilled AWS Data Engineers to design, build, and maintain scalable data pipelines. Candidates should be proficient in Python, SQL, and AWS services.

The role includes containerisation with Docker and collaboration with cross-functional teams to ensure robust data infrastructure is delivered. Attractive benefits include private medical cover, 25 days holiday plus additional leave, and a discretionary bonus.