Data Engineer

Tata Consultancy Services; Hyderabad; On-site; INR 1,400,000 - 2,100,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is hiring an Azure Data Engineer to design, build, and optimize data pipelines and data models for large-scale processing. Candidates should have 5+ years of hands-on experience with cloud data platforms and a strong focus on performance and scalability.

Expertise in PySpark, Python, SQL, and big data concepts is essential, with hands-on work on Azure Databricks, Azure Data Lake, and Azure Data Factory.

Qualifications

• Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines and data models for large-scale processing
• Deep expertise in data modeling concepts for large datasets, ensuring scalable and high-performing designs
• Strong software engineering with a focus on testing and code quality
• Proficiency in Python for data processing and analysis
• Experience with PySpark for batch and real-time data workflows
• Hands-on experience with Azure Databricks, Azure Data Lake and Azure Data Factory
• In-depth knowledge of PySpark performance tuning techniques
• Strong SQL skills for querying and optimizing large datasets

Skills

Azure Databricks

Azure Data Lake

PySpark

Python

Data modeling

Data pipelines

SQL

Big data

Job description

Job opportunity for Azure Data Engineer_Hyderabad_Face to face interview

Dear Candidate,

We are hiring for Azure Data Engineer with Tata Consultancy Services (TCS)

.

ksExperience: 5+ Yea

ugJ

• D:Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines, data models and PySpark for large-scale data processing and analys
• isExtensive experience and deep expertise in data modeling and data model concepts, particularly with large datasets, ensuring the design and implementation of efficient, scalable, and high-performing data model
• s.Strong software engineer, you take pride in what you’re developing with a strong testing etho
• s.String proficiency in Python programming, with a focus on data processing and analys
• isExtensive experience in designing, building, and optimizing ADB/PySpark pipelines and architectures, with a strong focus on supporting both batch and real-time data workflow
• s.Hand-on Experience with cloud technologies and big data concepts, especially in Azure Databricks, Azure Data Lake and Azure Data Facto
• ryIn-Depth Knowledge of PySpark, including experience with PySpark performance tuning techniques to optimal processing efficien
• cyStrong SQL skills for querying and manipulating large datasets, with experience in optimizing complex queries for performan