Senior Data Engineer: AWS/PySpark, Snowflake & DBT

Tata Consultancy Services; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Tata Consultancy Services in London is seeking a Senior Data Engineer to join the Data Engineering team focused on Customer value understanding and delivering scalable data solutions.

You will design, build and maintain production-grade data pipelines across AWS, PySpark, Snowflake and SQL-based transformations, while driving best practices in CI/CD, DevOps and data modelling in a cross-functional environment.

Qualifications

• Extensive experience with AWS data stack (S3, EMR, EC2, etc.).
• Proficient in PySpark, Snowflake, and DBT.
• Familiar with CI/CD, DevOps practices and GitHub Actions.
• Strong data modelling and large-scale data processing skills.
• Experience with SQL-based transformation frameworks.
• Exposure to MLOps and data science pipelines.

Responsibilities

• Design, build and maintain production data pipelines on AWS stack.
• Develop modular data models and transformation pipelines with DBT.
• Improve pipeline robustness via automation, monitoring, validation.
• Diagnose failures, support reruns and data quality fixes.
• Contribute to CI/CD and IaC practices using Terraform.

Skills

AWS data stack

PySpark

Snowflake

DBT

GitHub Actions

Terraform

CI/CD

DevOps

Data modelling

MLOps

SDLC

Cross-functional

Tools

GitHub Actions

Terraform

SQL

dbt

Job description

Tata Consultancy Services in London is seeking a Senior Data Engineer to join the Data Engineering team focused on Customer value understanding and delivering scalable data solutions.

You will design, build and maintain production-grade data pipelines across AWS, PySpark, Snowflake and SQL-based transformations, while driving best practices in CI/CD, DevOps and data modelling in a cross-functional environment.