Data Engineer

r3 Consultant; Hyderabad; On-site; INR 1,000,000 - 1,500,000; Full time

Job summary

r3 Consultant is seeking experienced Data Engineers in India, particularly in Hyderabad. The role demands expertise in Azure, Databricks, and PySpark to design and maintain scalable data pipelines. Ideal candidates should have 5-10 years of experience and the ability to optimize data workflows while collaborating with business teams. Additionally, knowledge of SAP HANA or SAP BW is a plus. The position offers opportunities to guide junior engineers and participate in strategic discussions.

Qualifications

• 5-10 years of experience in data engineering, preferably working with Azure services.
• Hands-on experience with building scalable data pipelines.
• Familiarity with cloud-based data platforms.

Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Work on Azure data services for data ingestion, transformation, and storage.
• Optimize and monitor data workflows for performance and reliability.
• Collaborate with analytics and business teams to understand data requirements.
• Implement best practices in data engineering and data governance.
• Participate in client discussions and technical evaluations.
• Guide junior team members and support architectural decisions for senior/lead roles.

Skills

Microsoft Azure

Azure Databricks

PySpark

Azure data engineering concepts

Databricks architecture and optimization

PySpark development and performance tuning

Data engineering and analytics fundamentals

Job description

Job Summary

We are looking for experienced Data Engineers with strong expertise in Azure, Databricks, and PySpark. The ideal candidate should have hands‑on experience building scalable data pipelines and working on cloud‑based data platforms. Candidates with exposure to SAP HANA or SAP BW will be preferred.

Role Details

Location: Bengaluru / Noida / Hyderabad

Experience: 5-10 Years

NP: Immediate to 15 Days

Mandatory Skills

• Microsoft Azure
• Azure Databricks
• PySpark

Good to Have

• SAP HANA
• SAP BW

Roles and Responsibilities

• Design, develop, and maintain scalable data pipelines using Azure Databricks and PySpark.
• Work on Azure data services for data ingestion, transformation, and storage.
• Optimize and monitor data workflows for performance and reliability.
• Collaborate with analytics and business teams to understand data requirements.
• Implement best practices in data engineering and data governance.
• Participate in client discussions and technical evaluations.
• For senior/lead roles, guide junior team members and support architectural decisions.

Skills to be Evaluated

• Azure data engineering concepts
• Databricks architecture and optimization
• PySpark development and performance tuning
• Data engineering and analytics fundamentals