AWS Data Engineer

Tata Consultancy Services; Bengaluru; On-site; INR 1,800,000 - 2,400,000; Full time

Job summary

Tata Consultancy Services in Bangalore is hiring for an AWS Data Engineer to design and maintain data pipelines using AWS and PySpark. The role requires 5+ years of experience and expertise with Python, SQL databases, and big data tools.

It offers a direct walk-in opportunity for candidates meeting the experience criteria. Location is Bengaluru with on-site work expectations, focusing on data transformation, calculation engines, and collaboration with software engineers throughout the

Qualifications

• 5+ years of hands-on data engineering experience.
• Proficient in Python, PySpark, and AWS data services.
• Experience with PostgreSQL or MongoDB.
• Strong collaboration and code review skills.

Responsibilities

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks.
• Manage efficiently large datasets.
• Manage SQL databases - PostgreSQL or MongoDB.
• Implement and maintain complex data calculation formulas.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Skills

Python

PySpark

AWS S3

Lambda Functions

Pandas

Education

BE/B.Tech/BCA/MCA/MSC

Tools

Databricks

Job description

We are hiring AWS Data Engineer role for Bangalore Location.

***Direct Walk-In Opportunity – 5+ Years experience required***

Location: Tata Consultancy Services Kochi, TCS, Discoverer Building, INTERNATIONAL TECH PARK (ITPL), 4th, G1, Whitefield Main Rd, Pattandur Agrahara, Whitefield, Bengaluru, Karnataka 560066.

Registration time: 9:00 AM - 12:30 PM

Skills: Python, Pyspark, AWS S3, Lyabda Functions, Pandas.

Experience: 5+ years

15 years of full time educationBE/B.TECH/BCA/MCA/MSC

Job Description:

Must Have Skills:

The successful candidate will be responsible for

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Responsibility of / Expectations from the Role:

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.