Senior Data Engineer

Tata Consultancy Services; Greater London; Hybrid; GBP 90,000 - 120,000; Full time

Job summary

Tata Consultancy Services in London is seeking a Senior Data Engineer to join the Data Engineering team focused on Customer value understanding and delivering scalable data solutions.

You will design, build and maintain production-grade data pipelines across AWS, PySpark, Snowflake and SQL-based transformations, while driving best practices in CI/CD, DevOps and data modelling in a cross-functional environment.

Qualifications

• Extensive experience with AWS data stack (S3, EMR, EC2, etc.).
• Proficient in PySpark, Snowflake, and DBT.
• Familiar with CI/CD, DevOps practices and GitHub Actions.
• Strong data modelling and large-scale data processing skills.
• Experience with SQL-based transformation frameworks.
• Exposure to MLOps and data science pipelines.

Responsibilities

• Design, build and maintain production data pipelines on AWS stack.
• Develop modular data models and transformation pipelines with DBT.
• Improve pipeline robustness via automation, monitoring, validation.
• Diagnose failures, support reruns and data quality fixes.
• Contribute to CI/CD and IaC practices using Terraform.

Skills

AWS data stack

PySpark

Snowflake

DBT

GitHub Actions

Terraform

CI/CD

DevOps

Data modelling

MLOps

SDLC

Cross-functional

Tools

GitHub Actions

Terraform

SQL

dbt

Job description

Job Type: Permanent

Work Mode: Hybrid

Location: London

Number of hours: 40 hours per week – full time

Ready to utilize your experience and expertise in Senior Data Engineer?

We have an exciting role for you - Senior Data Engineer!

Careers at TCS: It means more

TCS is a purpose-led transformation company, built on belief. We do not just help businesses to transform through technology. We support them in making a meaningful difference to the people and communities they serve - our clients include some of the biggest brands in the UK and worldwide. For you, it means more to make an impact that matters, through challenging projects which demand ambitious innovation and thought leadership.

The Role

Looking for an experienced Data Engineer to join Data Engineering team for Customer value Understanding and star making value.

Your responsibilities

The main areas of focus for this role over the next few months will include:

• Designing, building and maintaining production-grade data pipelines and services across AWS, PySpark, Snowflake and SQL-based transformation frameworks
• Developing and maintaining modular, testable and high-quality data models and transformation pipelines using DBT or equivalent structured SQL frameworks
• Improving pipeline robustness through automation, monitoring, validation, dependency management and engineering best practices to reduce manual intervention and production failures
• Diagnosing and resolving pipeline failures, supporting reruns and validations, and addressing data quality issues to maintain continuity of critical customer-facing use cases
• Contributing to CI/CD and DevOps practices including GitHub Actions, version control, testing disciplines and exposure to Infrastructure-as-Code such as Terraform

Your Profile

Essential skills/knowledge/experience:

• Experience with AWS data stack (S3, EMR, EC2, etc.)
• PySpark & Snowflake & CI/CD & DevOps
• Performance optimisation and large-scale data processing
• Data modelling (RDV/BDV or similar patterns preferred)
• Query performance tuning
• DBT (or equivalent SQL transformation framework)
• Development of modular, testable data models
• Experience working in structured transformation frameworks (e.g. dbt, Grid-style approaches)
• Hands-on experience with GitHub Actions (or similar)
• Exposure to Infrastructure-as-Code (e.g. Terraform)
• Experience working in engineering-led environments with strong SDLC practices
• Strong software engineering principles (testing, modularity, version control)
• Experience working in cross-functional product/data teams
• Ability to contribute to design and solutioning discussions
• Exposure to MLOps / data science pipelines
• Previous experience working in retail/large-scale customer data environments

TCS is consistently voted a Top Employer in the UK and globally. Our competitive salary packages feature pension, health care, life assurance, laptop, phone, access to extensive training resources and discounts within the larger Tata network.

We offer health & wellness initiatives and sports events; we are the proud Sponsor of the London Marathon.

Diversity, Inclusion and Wellbeing

Tata Consultancy Services UK&I is committed to meeting the accessibility needs of all individuals in accordance with the UK Equality Act 2010 and the UK Human Rights Act 1998.

We welcome and embrace diversity in race, nationality, ethnicity, disability, neurodiversity, gender identity, age, physical ability, gender reassignment, sexual orientation. We are a disability inclusive employer and encourage disabled people to apply for this role.

As a Disability Confident Employer, we offer an interview to applicants with disabilities or long-term conditions who meet the minimum criteria for the role. Please email us at [e-mail] if you would like to opt in.

If you are an applicant who needs any adjustments to the application process or interview, please contact us at [e-mail] with the subject line: “Adjustment Request” or call TCS London Office 02031552100 / [phone] to request an adjustment. We welcome requests prior to you completing the application and at any stage of the recruitment process.