Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking an Azure Data Engineer with 5+ years of hands-on experience to design and optimize data pipelines using PySpark, Python, and SQL. The role focuses on Azure Databricks, Data Lake, and Data Factory to support large-scale data processing and analytics.

The candidate should be proficient in data modeling, performance tuning, and building reliable data workflows in a hands-on, collaborative environment.

Qualifications

• 5+ years hands-on experience in designing, building, and optimizing data pipelines and PySpark for large scale data processing.
• Extensive experience in data modeling for large datasets and high-performing data models.
• Strong software engineering mindset with emphasis on testing and code quality.
• Proficiency in Python for data processing and analytics.
• Experience with Azure data services, Databricks, and big data concepts (batch and real-time).

Responsibilities

• Design, build, and optimize data pipelines using PySpark and SQL.
• Model and optimize data structures and data models for scale and performance.
• Develop data solutions using Azure Databricks, Data Lake, and Data Factory.
• Tune PySpark performance and ensure reliable data processing workflows.
• Collaborate with data teams to deliver end-to-end analytics solutions.

Skills

PySpark

Python

SQL

Azure Databricks

Azure Data Lake

Azure Data Factory

Data modeling

Tools

Azure Databricks

Azure Data Lake

Azure Data Factory

Job description

Job opportunity for Azure Data Engineer_Hyderabad_Face to face interview

Dear Candidate,

We are hiring for Azure Data Engineer with Tata Consultancy Services (TCS)

.

ksExperience: 5+ Yea

rsOnly apply if you are available to attend face to face interview for coming Saturday 1st A

ugJ

• D:Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines, data models and PySpark for large-scale data processing and analys
• isExtensive experience and deep expertise in data modeling and data model concepts, particularly with large datasets, ensuring the design and implementation of efficient, scalable, and high-performing data model
• s.Strong software engineer, you take pride in what you’re developing with a strong testing etho
• s.String proficiency in Python programming, with a focus on data processing and analys
• isExtensive experience in designing, building, and optimizing ADB/PySpark pipelines and architectures, with a strong focus on supporting both batch and real-time data workflow
• s.Hand-on Experience with cloud technologies and big data concepts, especially in Azure Databricks, Azure Data Lake and Azure Data Facto
• ryIn-Depth Knowledge of PySpark, including experience with PySpark performance tuning techniques to optimal processing efficien
• cyStrong SQL skills for querying and manipulating large datasets, with experience in optimizing complex queries for performan