Azure Databricks Healthcare +Mosaic AI/Agentic AI - Manager

PwC; India; On-site; INR 800,000 - 3,200,000; Full time

Job summary

PwC in India seeks a senior data engineering leader to design scalable data infrastructure and drive data-driven initiatives. You will architect pipelines, manage teams, and collaborate with business leaders to deliver secure, reliable analytics platforms.

Experience with Azure Databricks, Snowflake, Hadoop, and Airflow is essential. Strong communication in English is required for cross-functional partnerships and client-facing activities.

Qualifications

• Bachelor's degree required.
• 8+ years of experience in data engineering or a related field.
• Excellent written and spoken English proficiency.

Responsibilities

• Design and implement scalable data infrastructure and systems for efficient data processing and analysis.
• Develop and manage data pipelines, integration, and transformation using Azure Databricks and other platforms.
• Lead teams in strategic planning and execution of data-driven projects aligned with client expectations.
• Utilize technologies such as Hadoop and Airflow to enhance data processing capabilities.
• Oversee deployment and optimization of data warehouses, ensuring data quality and security.
• Collaborate with business and technology leaders to address data challenges and opportunities.
• Mentor team members to grow data engineering capabilities and foster innovation.
• Validate data integrity and compliance within analytics frameworks for informed decision-making.
• Promote cloud analytics platforms like Snowflake and AWS for enhanced insights generation.
• Encourage ongoing learning and development to adapt to evolving data technologies.

Skills

Data engineering

Team leadership

Agile

Mentoring

Data-driven decisions

Strategic planning

Education

Bachelor's degree

Tools

Azure Databricks

Snowflake

Apache Hadoop

Apache Airflow

AWS

Job description

Responsibilities

• - Designing and implementing scalable data infrastructure and systems to support efficient data processing and analysis
• - Developing and managing data pipelines, integration, and transformation solutions using Azure Databricks and other data engineering platforms
• - Leading teams in the strategic planning and execution of data-driven projects, confirming alignment with client expectations
• - Utilizing advanced technologies such as Apache Hadoop and Apache Airflow to enhance data processing capabilities
• - Overseeing the deployment and optimization of data warehouses, confirming data quality and security
• - Collaborating with business and technology leaders to identify and address data challenges and opportunities
• - Mentoring team members to develop their skills and encourage innovation in data engineering practices
• - Validating data integrity and compliance within analytics frameworks to support informed decision-making
• - Promoting the use of cloud-based analytics platforms like Snowflake and AWS for enhanced insights generation
• - Encouraging a culture of continuous learning and development within the team to adapt to evolving data technologies

What You Must Have

• - At least a Bachelor's degree
• - At least 8+ years of experience
• - Oral and written proficiency in English required

What Sets You Apart

• - Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• - Demonstrating proficiency in Microsoft Azure Databricks and Snowflake platforms
• - Utilizing advanced data engineering techniques for complex data transformations
• - Excelling in strategic planning and execution within data modernization projects
• - Leading teams in agile environments to deliver data-driven solutions
• - Mentoring junior staff to enhance their data engineering capabilities
• - Embracing technology and innovation to drive client success