AWS Data Engineer - Walkin - Bangalore - 12th September

Tata Consultancy Services; Bengaluru; On-site; INR 2,000,000 - 3,200,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is hiring an Azure Data Engineer with 6–13 years of experience to design, build, and maintain data pipelines. The role involves PySpark/Databricks processing, managing large datasets, and working with SQL databases such as PostgreSQL or MongoDB.

Collaboration with software engineers and participation in code reviews are expected. The position requires strong Python skills, experience with AWS services, and the ability to contribute to automation, testing,

Qualifications

• 6–13 years of relevant experience as a data engineer.
• Hands-on with AWS data services and PySpark/Databricks.
• Experience in managing large datasets and SQL databases.
• Strong collaboration and participation in code reviews.
• Minimum qualification: 15 years of full-time education.

Responsibilities

• Design, build, and maintain data pipelines using AWS and Python.
• Develop PySpark/Databricks data processing and calculation engines.
• Manage large datasets and SQL databases (PostgreSQL or MongoDB).
• Collaborate with software engineers and participate in reviews.
• Contribute to automation, testing, and deployment processes.

Skills

Python programming

Data pipeline design

AWS services

Collaborative software development

Education

15 years of full-time education

Tools

AWS Lambda

AWS Step Functions

PySpark

Databricks

PostgreSQL

MongoDB

Job description

Job description

TCS has been a great pioneer in feeding the fire of Young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together.

TCS is Hiring for Azure Data Engineer

Experience Range: 6-13 years Interview Location - TCS, Discoverer Building, INTERNATIONAL TECH PARK (ITPL), 4th, G1, Whitefield Main Rd, Pattandur Agrahara, Whitefield, Bengaluru, Karnataka 560066

Job Description

Job Requirements*

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Key Responsibilities*

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Minimum Qualification: 15 years of full-time education