Senior Data Engineer

LA International; City Of London; Hybrid; GBP 74,000 - 92,000; Part time

Job summary

LA International seeks a Senior Data Engineer to design and build production-grade data pipelines on AWS, PySpark and Snowflake. You will create modular data models, optimise performance and contribute to CI/CD and DevOps practices in a hybrid London environment.

The role involves hands-on development, data quality management and collaboration with cross-functional teams to deliver reliable, scalable data solutions. 6-month contract with extensions may apply.

Qualifications

• Experience with AWS data stack (S3, EMR, EC2, etc.).
• PySpark experience in production-grade data pipelines.
• Strong data modelling and SQL transformation skills.
• Experience with DBT or equivalent SQL frameworks.
• Familiarity with CI/CD and DevOps practices.

Responsibilities

• Design, build and maintain production-grade data pipelines and services across AWS, PySpark, Snowflake and SQL-based transformation frameworks.
• Develop modular, testable data models and transformations using DBT or equivalent SQL frameworks.
• Improve pipeline robustness via automation, monitoring, validation and CI/CD practices.
• Diagnose and resolve pipeline failures, support reruns and data quality tasks.
• Contribute to CI/CD and Infrastructure-as-Code practices (Terraform, GitHub Actions).

Skills

AWS data stack

PySpark

Production-grade pipelines

Performance optimisation

Snowflake

Data modelling

Query performance tuning

DBT

Cross-functional teams

CI/CD

GitHub Actions

Terraform

Testing disciplines

SDLC

Tools

Terraform

GitHub Actions

DBT

Job description

Senior Data Engineer

6 Month contract initially + Extensions

Based: Hybrid - London. 2 days p/w onsite

Rate - £400 - £500 p/d via Umbrella

We have a great opportunity with a world leading organisation where you will be provided with all of the support and development to succeed. A progressive organisation where you can really make a difference. We have a great opportunity for a Senior Data Engineer on a long term program of work.

This is an excellent opportunity on a great project of work,

Key Responsibilities:

• Designing, building and maintaining production-grade data pipelines and services across AWS, PySpark, Snowflake and SQL-based transformation frameworks
• Developing and maintaining modular, testable and high-quality data models and transformation pipelines using DBT or equivalent structured SQL frameworks
• Improving pipeline robustness through automation, monitoring, validation, dependency management and engineering best practices to reduce manual intervention and production failures
• Diagnosing and resolving pipeline failures, supporting reruns and validations, and addressing data quality issues to maintain continuity of critical customer-facing use cases
• Contributing to CI/CD and DevOps practices including GitHub Actions, version control, testing disciplines and exposure to Infrastructure-as-Code such as Terraform

Key Skills & Experience:

• Experience with AWS data stack (S3, EMR, EC2, etc.)
• PySpark
• Production-grade data pipelines
• Performance optimisation and large-scale data processing
• Snowflake
• Data modelling (RDV/BDV or similar patterns preferred)
• Query performance tuning
• DBT (or equivalent SQL transformation framework)
• Development of modular, testable data models
• Experience working in structured transformation frameworks (e.g. dbt, Grid-style approaches)
• CI/CD & DevOps
• Hands-on experience with GitHub Actions (or similar)
• Exposure to Infrastructure-as-Code (e.g. Terraform)
• Experience working in engineering-led environments with strong SDLC practices
• General engineering maturity
• Strong software engineering principles (testing, modularity, version control)
• Experience working in cross-functional product/data teams
• Ability to contribute to design and solutioning discussions

LA International is an award-winning partner of choice for many of the world's most influential companies and government organisations. Holding Enhanced Government Security Accreditation, we are recognised as the European market leader in the delivery of Security Cleared talent to organisations that demand the very highest levels of security, compliance and assurance.

A multiple award-winning organisation, having secured the prestigious Queens Award for Enterprise: International Trade over consecutive years. We are committed to fostering an inclusive, equitable and accessible workplace where everyone feels valued and supported. We welcome applications from all individuals, regardless of background or identity, and we encourage candidates who may not meet every listed requirement to still apply.

If you require any adjustments or support during the recruitment process, please let us know and we will work with you to ensure a fair and accessible experience.

Please Note: If a high volume of applications is received, only candidates shortlisted will be contacted.