Walk-in | Aws Data Engineer( Walkin Benguluru SEP 12TH )

Tata Consultancy Services; Bengaluru; On-site; INR 800,000 - 1,300,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking a data engineer to design, build, and maintain data transformation pipelines using AWS services (Lambda, Step Functions) and PySpark. You will also work with Databricks and implement a complex calculation engine while handling large datasets.

Additionally, you will collaborate with software engineers on code reviews, design discussions, and deployment processes, contributing to automation and testing efforts across projects.

Job description

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.

Contribute to automation, testing, and deployment processes.