Engineering - Azure, AWS, DBT - Senior Associate

PwC Acceleration Center India; Bengaluru; On-site; INR 1,800,000 - 3,000,000; Full time

Job summary

PwC Acceleration Center India is seeking an Engineering Manager specializing in Azure, AWS, and DBT to lead scalable data engineering solutions and mentor junior engineers. You will work with clients and cross-functional teams to deliver data modernization and product innovation across our Data and Analytics Engineering group.

You will oversee data pipelines, architectures, and data governance while ensuring quality, security, and timely delivery in a fast-paced, collaborative environment.

Qualifications

• Bachelor's degree required.
• Minimum 2 years of data engineering experience.
• English proficiency (oral and written).
• Experience with Azure ADLS, Databricks, Data Flows, HDInsight, and Azure Analysis Services.
• Strong knowledge of Hadoop and Spark.
• Experience extracting data from flat files, XML, JSON, Parquet, and RDBMS sources.
• Understanding DW lifecycle and data modelling concepts.
• Experience with testing/validation practices (unit test plans, code reviews).
• Ability to mentor junior team members and collaborate with cross-functional teams.

Responsibilities

• Lead design and implementation of scalable data engineering solutions on Azure and AWS.
• Manage data pipelines with Airflow and Azure Data Factory.
• Develop and optimize data architectures for integration and transformation.
• Build and maintain data warehouses and data lakes; ensure data quality and security.
• Leverage Databricks and Snowflake to enhance analytics capabilities.
• Collaborate with cross-functional teams to drive data strategy and innovation.
• Apply database optimization techniques for performance tuning.
• Guide junior engineers and promote best practices in data engineering.
• Ensure compliance with data governance and security standards.
• Define and implement data governance policies.

Skills

Azure ADLS

Databricks

Data Bricks

Data Flows

HDInsight

Azure Analysis Services

Hadoop

Spark

English proficiency

Data extraction

Education

Bachelor's degree

Tools

Apache Airflow

Azure Data Factory

Snowflake

Databricks

Snowflake Data Warehouse

Big Data tooling

Job description

The Opportunity Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You'll work at the heart of global teams across Advisory, Assurance, Tax and Business Services - solving real client challenges through connected collaboration. We'll help you grow your skills so you can go further. With hands-on learning, cutting-edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference - every day.

As an Engineering Manager specializing in Azure, AWS, and DBT, you will lead the charge in transforming data engineering processes within our Data and Analytics Engineering group. Your role will involve working directly with clients to deliver innovative solutions that drive data modernization and product innovation. Within our Cloud Engineering, Data & Analytics network, you will be at the forefront of leveraging cutting-edge technologies to enhance client outcomes and streamline data operations.

As a Senior Associate, you will utilize your problem-solving skills and critical thinking to navigate complex challenges and build meaningful client relationships. You will guide and mentor junior team members, fostering their growth while maintaining professional and technical standards. Your ability to anticipate client needs and embrace ambiguity will be crucial in delivering quality solutions and growing your personal brand.

In this role at PwC Acceleration Center India, you will collaborate with multidisciplinary teams to develop and implement data strategies that align with business objectives. Your contributions will be pivotal in driving continuous improvement and innovation, confirming that our clients receive tailored solutions that meet their evolving needs.

Responsibilities

• Leading the design and implementation of scalable data engineering solutions using Azure and AWS platforms
• Managing data pipelines and workflows with tools such as Apache Airflow and Azure Data Factory
• Developing and optimizing data architectures to support data integration and transformation processes
• Building and maintaining data warehouses and lakes, confirming data quality and security
• Utilizing Databricks and Snowflake platforms to enhance data analytics capabilities
• Collaborating with cross-functional teams to drive data strategy and innovation
• Implementing database management and optimization techniques for performance tuning
• Analyzing complex data sets to inform business decisions and improve data infrastructure
• Mentoring junior team members in data engineering practices and methodologies
• Confirming compliance with data governance and security best practices

What You Must Have

• At least a Bachelor's degree
• At least 2 years of experience
• Oral and written proficiency in English required4+ years of experience working in Azure ADLS, Data Bricks, Data Flows, HDInsight, Azure Analysis services
• Should be aware of Data Management concepts and Data Modelling
• Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
• Should have expertise in extracting data from different source systems like flat files, XML sources, JSON, Parquet files, Big data appliances, RDBMS, etc.
• Good knowledge of Big Data frameworks and related technologies - Experience in Hadoop and Spark is mandatory
• Should have clear understanding of DW lifecycle and contributed in preparing
• Detail Level Design document
• Unit Test plans
• Code review reports

What Sets You Apart

• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Demonstrating proficiency in Amazon Web Services (AWS) and Microsoft Azure
• Utilizing Apache Airflow and Databricks for data pipeline management
• Excelling in data architecture development and database optimization
• Leveraging experience with Snowflake Data Warehouse and data modeling
• Applying analytical thinking to solve complex data engineering challenges
• Embracing change and demonstrating learning agility in dynamic environments