Fabric+Pyspark+SQL

PwC; India; Hybrid; INR 2,500,000 - 4,000,000; Full time

Job summary

PwC in India is seeking an senior Data Engineer to design and implement robust data pipelines and integration solutions, building scalable data infrastructure across Hadoop, Azure Data Factory, Snowflake and Databricks. You will transform raw data into actionable insights and drive data-driven strategies for client engagements.

The role requires 8+ years of experience, strong English communication, and leadership skills to mentor teams and collaborate with stakeholders on data optimization and

Qualifications

• At least a Bachelor's degree.
• At least 8+ years of experience.
• Oral and written proficiency in English required.

Responsibilities

• Designing and implementing data pipelines and integration solutions to support efficient data processing and analysis.
• Developing and maintaining data infrastructure using platforms such as Apache Hadoop and Azure Data Factory.
• Utilizing advanced data engineering techniques to transform raw data into actionable insights for informed decision-making.
• Leading teams in the strategic planning and execution of data-driven initiatives to drive business growth.
• Coaching team members to leverage their unique strengths and manage performance to meet client expectations.
• Collaborating with stakeholders to identify opportunities for optimizing data utilization and improving business outcomes.
• Applying technical proficiency in cloud-based analytics platforms like Snowflake and Databricks to enhance data solutions.
• Validating data integrity and security within analytics frameworks to uphold professional standards.
• Encouraging innovation and embracing technology to enhance delivery and inspire team development.

Skills

Data pipelines

Data integration

Data infrastructure

Data modeling

Cloud data solutions

Agile methodologies

Mentoring teams

AI-human collaboration

Decision making

Education

Bachelor's degree

Tools

Apache Hadoop

Azure Data Factory

Snowflake

Databricks

AWS

Job description

Responsibilities

• Designing and implementing data pipelines and integration solutions to support efficient data processing and analysis
• Developing and maintaining data infrastructure using platforms such as Apache Hadoop and Azure Data Factory
• Utilizing advanced data engineering techniques to transform raw data into actionable insights for informed decision-making
• Leading teams in the strategic planning and execution of data-driven initiatives to drive business growth
• Coaching team members to leverage their unique strengths and manage performance to meet client expectations
• Collaborating with stakeholders to identify opportunities for optimizing data utilization and improving business outcomes
• Applying technical proficiency in cloud-based analytics platforms like Snowflake and Databricks to enhance data solutions
• Validating data integrity and security within analytics frameworks to uphold professional standards
• Encouraging innovation and embracing technology to enhance delivery and inspire team development

What You Must Have

• At least a Bachelor's degree
• At least 8+ years of experience
• Oral and written proficiency in English required

What Sets You Apart

• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Demonstrating proficiency in data engineering platforms and tools
• Utilizing cloud platforms like AWS and Azure for data solutions
• Excelling in data modeling and data pipeline development
• Leveraging AI-human collaboration to enhance data analytics
• Embracing agile methodologies for scalable data projects
• Mentoring teams in data strategy and transformation initiatives