Senior Data Engineer: Build Scalable Cloud Data Pipelines

Tata Consultancy Services; Stockholms kommun; On-site; SEK 700,000 - 950,000; Full time

Benefits offered by this job

30 Days of Annual Vacation

Union coverage

Pension scheme

Pension advisory services

Insurance

Benifex benefits portal

Learning platforms

Career growth

Job summary

Tata Consultancy Services in Sweden seeks an experienced Data Engineer to build scalable data pipelines and collaborate with business and tech teams. You will contribute to the development and maintenance of modern data pipelines across on-premise and cloud environments.

You will work in an agile squad, focusing on reliability, performance and governance while enabling advanced analytics and data-driven decision-making with PySpark, Airflow, SQL and Redshift.

Qualifications

• 5+ years of experience in data engineering, preferably within cloud data warehouse environments.
• Bachelor's degree in Computer Science, Engineering or a related field.
• Strong hands-on experience with PySpark and Apache Airflow.
• Strong SQL skills and a deep understanding of query performance.
• Solid understanding of data modelling principles, including dimensional modelling, Kimball, normalized models and hybrid strategies.
• Experience with AWS Redshift, including WLM, distribution and sort keys, query execution plan analysis and optimization techniques.
• Familiarity with monitoring tools such as CloudWatch and Redshift Console.
• Experience with data versioning, CI/CD, Git, Kubernetes and collaborative development practices in DBT.
• Fluent in English (written and spoken).

Responsibilities

• Design, build and maintain robust data pipelines that are scalable, efficient and aligned with business needs.
• Collaborate with cross-functional teams to understand requirements and translate them into effective data solutions.
• Ensure data quality, integrity and governance by applying best practices in data management.
• Develop data processes and workflows using tools such as PySpark and Apache Airflow.
• Support and enhance data platforms, databases and data warehouses to enable advanced analytics.
• Implement CI/CD pipelines using GitHub Actions and JFrog for automated deployment and version control.
• Troubleshoot data pipelines and resolve issues related to real-time processing, batch processing and integrations.

Skills

Data engineering

SQL

Team collaboration

Agile experience

English proficiency

Education

Bachelor's degree in Computer Science, Engineering or related field

Tools

PySpark

Apache Airflow

AWS Redshift

Git

Kubernetes

DBT

CloudWatch

Redshift Console

GitHub Actions

JFrog

Job description

Tata Consultancy Services in Sweden seeks an experienced Data Engineer to build scalable data pipelines and collaborate with business and tech teams. You will contribute to the development and maintenance of modern data pipelines across on-premise and cloud environments.

You will work in an agile squad, focusing on reliability, performance and governance while enabling advanced analytics and data-driven decision-making with PySpark, Airflow, SQL and Redshift.