Consultant Data engineer-6+Years- Bengaluru , Gurugram, Hyderabad

Crescendo Global Leadership Hiring India; Bengaluru; Hybrid; INR 1,700,000 - 3,200,000; Full time

Job summary

Crescendo Global is seeking a Consultant Data Engineer with 6+ years of experience to join a high-impact data engineering team in Bengaluru, Gurugram, and Hyderabad. The role focuses on building scalable data pipelines and modern Lakehouse architectures on Azure, collaborating across Analytics, Data Science, BI, and DevOps teams.

Candidates will work with Azure Databricks, Azure Data Factory, ADLS, and PySpark, enabling advanced analytics and enterprise-grade data solutions for global clients.

Qualifications

• 6+ years of experience in Data Engineering.
• Strong expertise in Azure Databricks, Azure Data Factory & ADLS.
• Hands-on proficiency in PySpark & Spark SQL.
• Strong understanding of ETL and data pipeline development.
• Advanced SQL skills.

Responsibilities

• Design and develop scalable data pipelines using PySpark & Spark SQL on Azure Databricks.
• Build and orchestrate ETL workflows using Azure Data Factory (ADF).
• Develop and maintain modern Lakehouse architecture using ADLS & Databricks.
• Perform data cleaning, normalization, deduplication, and transformation.
• Monitor pipelines, troubleshoot issues, and drive RCA and resolution.
• Collaborate with DevOps, Data Science, BI, and global Analytics teams.

Skills

Azure Databricks

Azure Data Factory

ADLS

PySpark

Spark SQL

ETL

SQL

Job description

Consultant Data engineer-6+Years- Bengaluru , Gurugram, Hyderabad

Join a high-impact data engineering team working on modern cloud data platforms, scalable pipelines, and enterprise analytics. This role offers the opportunity to work on Azure Databricks, Lakehouse architecture, PySpark, and advanced data engineering initiatives while collaborating with global analytics, Data Science, BI, and DevOps teams.

Location - Bengaluru , Gurugram, Hyderabad

Your Future Employer - AI & Analytics organization delivering advanced data engineering, analytics, governance, MLOps, and Generative AI solutions for major organizations across industries. The organization offers an environment focused on innovation, collaboration, continuous learning, and solving complex business challenges.

Responsibilities

• 1. Design and develop scalable data pipelines using PySpark & Spark SQL on Azure Databricks.
• 2. Build and orchestrate ETL workflows using Azure Data Factory (ADF).
• 3. Develop and maintain modern Lakehouse architecture using ADLS & Databricks.
• 4. Perform data cleaning, normalization, deduplication, and transformation.
• 5. Monitor pipelines, troubleshoot issues, and drive RCA and resolution.
• 6. Collaborate with DevOps, Data Science, BI, and global Analytics teams.

Requirements

• 1. 6+ years of experience in Data Engineering.
• 2. Strong expertise in Azure Databricks, Azure Data Factory & ADLS.
• 3. Hands-on proficiency in PySpark & Spark SQL.
• 4. Strong understanding of ETL and data pipeline development.
• 5. Advanced SQL skills.

What is in it for you

• 1. Opportunity to work on large-scale cloud data engineering projects.
• 2. Exposure to Databricks, Lakehouse architecture & Azure ecosystem.
• 3. Cross-functional collaboration with Analytics, Data Science, BI & DevOps teams.
• 4. Strong platform for technical growth and career progression.

Crescendo Global does not discriminate based on race, religion, colour, origin, gender, sexual orientation, age, marital status, veteran status or disability status.

Keywords -Data Engineer, Consultant Data Engineer, Azure Data Engineer, Databricks, Azure Databricks, PySpark, Spark SQL, Azure Data Factory, ADF, ADLS, Azure, ETL, Data Pipelines, Lakehouse, Advanced SQL, Data Engineering, Data Analytics, Cloud Data Engineer, Big Data, Data Migration