Azure Data Engineer-ADF, Databricks, Python , Snowflake , Denodo, SQL

Tata Consultancy Services; Hyderabad, Bengaluru; On-site; INR 1,500,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services is seeking an experienced data engineering professional in Hyderabad to design, develop, and maintain large-scale data pipelines using Azure Data Factory and Snowflake. You will write Python code for data manipulation, collaborate with cross-functional teams, and ensure scalable and secure solutions.

Ideal candidates have 8–12 years of IT experience, Azure proficiency, and strong SQL skills for Snowflake environments. Bachelor's degree required.

Qualifications

• 8–12 years IT experience with ADF, Databricks, and Python.
• Strong cloud experience with Microsoft Azure.
• Proficient in writing complex SQL queries for Snowflake databases.
• Bachelor's degree in tech (B.Tech/B.E.).

Responsibilities

• Design, develop, and maintain large-scale data pipelines with ADF to move data into Snowflake.
• Collaborate with cross-functional teams to gather requirements and design solutions.
• Develop high-quality Python code using Pandas, NumPy, and Matplotlib for data manipulation and visualization.
• Ensure scalability, security, and performance by optimizing queries on SQL Server.
• Troubleshoot pipeline failures or errors in ADF workflows.

Skills

ADF

Databricks

Python

Azure

SQL

Education

Bachelor's degree (B.Tech / B.E.)

Tools

Snowflake

SQL Server

Job description

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Snowflake.
  
• Collaborate with cross-functional teams to gather requirements and design solutions for complex business problems.
  
• Develop high-quality code in Python using Pandas, NumPy, Matplotlib libraries for data manipulation and visualization.
  
• Ensure scalability, security, and performance of the system by implementing efficient algorithms and optimizing database queries on SQL Server.
  
• Troubleshoot issues related to pipeline failures or errors in ADF workflows.
  

Desired Candidate Profile

• 8-12 years of experience in IT industry with expertise in ADF, Databricks, Python programming language.
  
• Strong understanding of cloud computing concepts with hands‑on experience working with Microsoft Azure platform.
  
• Proficiency in writing complex SQL queries for querying large datasets stored in Snowflake databases.
  
• Bachelor's degree in Any Specialization (B.Tech / B.E.).