Walk-in | Tcs hiring For AZURE Data Engineer

Tata Consultancy Services; Bengaluru; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services is seeking a data engineer to design, build, and maintain Azure-based data pipelines in Python, leveraging PySpark and Databricks for complex calculations.

You will manage large datasets and SQL databases (PostgreSQL or MongoDB), collaborating with software engineers and contributing to CI/CD, testing, and deployment processes.

Qualifications

• Experience building data pipelines using Azure services and Python.
• Proficiency with PySpark and Databricks for data processing.
• Ability to handle large datasets and complex calculations.
• Experience with SQL databases such as PostgreSQL or MongoDB.

Responsibilities

• Design, build, and maintain data transformation pipelines using Azure services (Azure Functions, Step Functions) in Python.
• Develop data pipelines with PySpark and Databricks; implement complex calculation engines.
• Efficiently manage large datasets and scalable SQL databases.
• Collaborate with software engineers; participate in code reviews and design discussions.
• Contribute to automation, testing, and deployment processes.

Skills

Azure Functions

Python

PySpark

Databricks

SQL

Tools

PostgreSQL

MongoDB

Job description

Job Requirements*

• Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.

Responsibilities*

• Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.

Contribute to automation, testing, and deployment processes.