Azure Data Engineer

Tata Consultancy Services; Pune District, Mumbai, Kolkata District; On-site; INR 600,000 - 1,200,000; Full time

Job summary

Tata Consultancy Services is seeking a skilled professional in Pune District. The ideal candidate must possess strong design and data solutioning skills, with hands-on experience in PySpark and handling large datasets.

Essential skills include good command of Python and experience with various Azure tools such as Azure Data Lake and Azure Data Factory. This role demands proficiency in database technologies including Oracle and SQL Server.

Qualifications

• Hands-on experience with complex transformations in PySpark and large datasets.
• Strong command in Python, familiar with OOP and functional programming.
• Experience with various Azure tools is a must.

Skills

PySpark

Python

Azure Data Lake

Data modeling

Oracle PL/SQL

NumPy

Pandas

Matplotlib

Tools

Jupyter

PyCharm

IDLE

Conda

Azure DevOps

Job description

Role & responsibilities

• Strong design and data solutioning skills
• PySpark hands‑on experience with complex transformations and large dataset handling experience
• Good command and hands‑on experience in Python. Experience working with following concepts, packages, and tools, a. Object oriented and functional programming b. NumPy, Pandas, Matplotlib, requests, pytest c. Jupyter, PyCharm and IDLE d. Conda and Virtual Environment
• Working experience must with Hive, HBase or similar
• Azure Skills a. Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases b. Azure DevOps c. Azure AD Integration, Service Principal, Pass‑thru login etc. d. Networking vnet, private links, service connections, etc. e. Integrations Event grid, Service Bus etc.
• Database skills a. Oracle, Postgres, SQL Server – any one database experience b. Oracle PL/SQL or T‑SQL experience c. Data modelling