Azure Data Engineer - 8th August ( Saturday ) -Virtual Interview

Tata Consultancy Services; Bengaluru, Delhi, Pune District; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Tata Consultancy Services is hiring for a data engineering role in Bengaluru. You will design, build, and maintain data transformation pipelines using Azure functions, PySpark, and Databricks, handling large datasets and complex calculations.

You will manage PostgreSQL or MongoDB databases and collaborate with software engineers on reviews, design discussions, and deployment automation. The position focuses on implementing scalable data processing, optimizing pipelines, and contributing to

Qualifications

• Design, build, and maintain data transformation pipelines using Azure services in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks.
• Manage efficiently large datasets and SQL databases (PostgreSQL or MongoDB).
• Implement complex data calculation formulas and participate in reviews and planning.

Responsibilities

• Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Skills

Python

Azure

PySpark

Databricks

SQL

PostgreSQL

MongoDB

Data pipelines

Tools

Azure Functions

Step Functions

PostgreSQL

MongoDB

Job description

Job Requirements*

• Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage efficiently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.

Key Responsibilities*

• Design, build, and maintain data transformation pipelines using AZURE services (Azure Functions, Step Functions .. ) in Python.
• Design, build, and maintain data transformation pipelines using PySpark and Databricks. Implement and maintain complex calculation engine.
• Manage effeciently large dataset.
• Manage SQL database - Postgresql or MongoDB.
• Implement and maintain complex data calculation formula.
• Open to collaborate with Software Engineers.
• Participate in code reviews, design discussions, and software planning.
• Contribute to automation, testing, and deployment processes.