Data Ingestion Engineer - AWS, Terraform & Pipelines

Ben; Greater London; On-site; GBP 70,000 - 100,000; Full time

Job summary

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform.

You will connect HR and payroll data pipelines, ensure secure, reliable data movement, and collaborate with product stakeholders to scope scalable solutions while adhering to security best practices.

Qualifications

• Strong experience with Python and SQL.
• A few years building and running production data pipelines that other people relied on.
• Comfortable with infrastructure as code, ideally Terraform.
• Hands-on AWS experience, for example Lambda, ECS, Glue, S3, and RDS.
• Good grasp of ETL/ELT and orchestration.
• Experience building or running data integrations and connectors is a plus.
• Solid software engineering fundamentals, including clean code, sensible design, and reliable tests.
• Security awareness when building applications and configuring infrastructure.
• Knowledge of enterprise data expectations.
• Experience with MCP server development or preparing data for AI agents is nice to have.
• Eligibility to work in the UK without visa sponsorship.
• Ability to commute to the London offices at least 3 times per week; Monday, Tuesday, and Thursday are mandatory.

Responsibilities

• Build and maintain ingestion pipelines into the data warehouse using Fivetran and custom pipelines
• Own data orchestration to keep data moving on schedule and recover cleanly from failures
• Build and manage AWS-based data infrastructure as code with Terraform
• Build enterprise-grade customer data pipelines and connectors for HR, payroll, and other systems
• Reliably and securely move customer data in and out at enterprise volumes
• Connect data to AI agents and services, including through MCP connectors
• Work with product and stakeholders to scope problems and agree on simple, scalable solutions
• Build according to security practices such as the OWASP Top 10 and AWS Well-Architected Framework

Skills

Python

SQL

Production data pipelines

ETL/ELT

Security awareness

Software engineering fundamentals

Tools

Terraform

AWS

Lambda

ECS

Glue

S3

RDS

Job description

Jobtailor in London is seeking an experienced Data Engineer to build and maintain ingestion pipelines into the data warehouse, orchestrate data flows, and manage AWS infrastructure as code with Terraform.

You will connect HR and payroll data pipelines, ensure secure, reliable data movement, and collaborate with product stakeholders to scope scalable solutions while adhering to security best practices.