Azure Data Engineer

Tata Consultancy Services; Pune City; On-site; INR 800,000 - 1,200,000; Full time

Job summary

A leading company in IT Services is seeking a Data Engineer for their Pune office. The ideal candidate will have extensive experience in Azure and Big Data technologies, focusing on building and optimizing data pipelines. This role requires strong programming skills in Python and proficiency in SQL, with a focus on data processing and analysis. Join a team that values innovation and efficiency in data solutions.

Qualifications

• 5 years of experience in designing and optimizing data pipelines and models.
• Proficiency in Python for data processing and analysis.

Responsibilities

• Designing, building, and optimizing Big Data pipelines and architectures.
• Working with Azure technologies for data processing.

Skills

Azure

Databricks

PySpark

Big Data

Python

SQL

Job description

Get AI-powered advice on this job and more exclusive features.

Required Technical Skill Set: Azure, Databricks, PySpark, Big Data

Desired Experience Range: 4yrs to 8yrs

Location of Requirement: Pune

Desired Competencies (Technical/Behavioral)

• Minimum of 5 years of hands-on experience in designing, building, and optimizing data pipelines, data models, and Spark-based applications in Big Data environments.
• Extensive experience and deep expertise in data modeling and data model concepts, particularly with large datasets, ensuring the design and implementation of efficient, scalable, and high-performing data models.
• Strong software engineering principles with pride in development and a strong testing ethos.
• Proficiency in Python programming, focusing on data processing and analysis.
• Proven experience working with PySpark for large-scale data processing and analysis.
• Extensive experience in designing, building, and optimizing Big Data pipelines and architectures, supporting both batch and real-time workflows.
• Hands-on experience with cloud technologies and Big Data concepts, especially Azure Databricks, Azure Data Lake, and Azure Data Factory.
• In-depth knowledge of Spark, including performance tuning techniques for optimal processing efficiency.
• Strong SQL skills for querying and manipulating large datasets, with experience in optimizing complex queries for performance.

Seniority level

• Mid-Senior level

Employment type

• Full-time

Job function

• Information Technology, Engineering, and Other

Industries

• IT Services and IT Consulting

Referrals increase your chances of interviewing at Tata Consultancy Services by 2x.

Get notified about new Data Engineer jobs in Pune, Maharashtra, India.

We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.