Walk-in | Tcs hiring For AWS Data Engineer

Tata Consultancy Services; Bengaluru; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking a data engineer to design, build, and maintain data transformation pipelines using AWS Lambda, Step Functions, Python, PySpark, and Databricks.

You will manage large datasets, optimize SQL databases like PostgreSQL or MongoDB, implement complex data calculation formulas, collaborate with software engineers, and participate in code reviews and deployments.

Qualifications

• Experience designing data pipelines on AWS (Lambda/Step Functions) in Python.
• Experience with PySpark and Databricks for data processing and transformation.
• Strong SQL skills and experience with PostgreSQL or MongoDB.
• Ability to manage large datasets and implement complex data calculation formulas.

Responsibilities

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.

Skills

AWS

Python

PySpark

Databricks

SQL

PostgreSQL

MongoDB

Data pipelines

Tools

Databricks

PySpark

Job description

Job Requirements*

The successful candidate will be responsible for

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.

Contribute to automation, testing, and deployment processes.

Key Responsibilities*

• Design, build, and maintain data transformation pipelines using AWS services (Lambda Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.

Contribute to automation, testing, and deployment processes.