AWS Data Engineer

Tata Consultancy Services; Bengaluru; On-site; INR 1,125,000 - 1,375,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking an experienced AWS Data Engineer to design and maintain large-scale data pipelines using AWS services, PySpark, and Databricks. The role focuses on transforming data, optimizing SQL databases like PostgreSQL or MongoDB, collaborating with software engineers, and contributing to automation, testing, and deployment processes.

Ideal candidates will have 6–13 years of hands-on experience, strong problem-solving skills, and a passion for building

Qualifications

• Experience with AWS data pipelines in Python.
• Hands-on PySpark and Databricks experience.
• Strong SQL experience with PostgreSQL or MongoDB.
• Ability to work with large datasets and implement data calculations.

Responsibilities

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions) in Python.
• Design, build, and maintain data pipelines with PySpark and Databricks; implement complex calculation engines.
• Efficiently manage large datasets.
• Manage SQL databases - PostgreSQL or MongoDB.
• Implement and maintain complex data calculation formulas.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Skills

Python

AWS services

Collaboration

Code reviews

Software planning

Education

15 years of full-time education

Tools

PySpark

Databricks

PostgreSQL

MongoDB

SQL

Job description

TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.

TCS is Hiring for AWS Data Engineer

Experience Range: 6-13 years

Job Description:

The successful candidate will be responsible for

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Key Responsibilities*

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Minimum Qualification: 15 years of full-time education