Senior Scrum Master

PriceWaterhouseCoopers Pvt Ltd ( PWC ); Bengaluru; On-site; INR 1,500,000 - 2,600,000; Full time

Job summary

PwC is seeking an experienced AWS Data Engineer with 4-8 years of hands-on experience to design, develop, and maintain scalable data pipelines on AWS. You will work with Snowflake, Apache Airflow, Python, PySpark, and SQL to build data solutions, collaborate with cross-functional teams, and ensure data quality and performance.

The role requires strong ETL/ELT experience, data warehousing concepts, and a proactive problem-solving approach in an Agile environment.

Qualifications

• 4-8 years of hands-on Data Engineering experience.
• Strong hands-on AWS Data Engineering experience.
• Strong Snowflake experience.
• Hands-on Apache Airflow and DAG development.
• Strong Python programming.
• Strong PySpark / Apache Spark experience.
• Advanced SQL skills.
• Understanding of ETL/ELT and data pipelines.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on AWS.
• Create and manage Airflow DAGs with scheduling, monitoring, retries, and error handling.
• Develop data transformations using Python and PySpark.
• Design and implement Snowflake data warehouses and related components.
• Write complex SQL queries, procedures, views, and data transformations.
• Collaborate with data architects, analysts, and stakeholders in an Agile/Scrum setup.
• Ensure data quality, monitoring, and performance optimization.

Skills

AWS Data Engineer

Snowflake

Apache Airflow

Python

PySpark

SQL

ETL/ELT

Data Pipelines

Git CI/CD

Education

Bachelor's or Master's in CS/IT/Engineering

Tools

Snowflake

Apache Airflow

Git

CI/CD

Job description

IN_Senior Associate_AWS Data Engineer_D&A_Advisory_Bangalore Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Senior Associate

Job Description & Summary

At PwC, our people in data and analytics focus on leveraging data to drive insights and make informed business decisions. They utilise advanced analytics techniques to help clients optimise their operations and achieve their strategic goals. In data analysis at PwC, you will focus on utilising advanced analytical techniques to extract insights from large datasets and drive data-driven decision-making. You will leverage skills in data manipulation, visualisation, and statistical modelling to support clients in solving complex business problems.

Why PWC

At PwC , you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us .

At PwC , we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations.

Job Description & Summary: A Career within .........................

We are looking for an experienced AWS Data Engineer with 4-8 years of hands‑on experience in designing, developing, and maintaining scalable data pipelines and cloud-based data platforms. The ideal candidate will have strong expertise in AWS, Snowflake, Apache Airflow, Python, PySpark, and SQL, with a solid understanding of data warehousing, ETL/ELT, data modeling, and performance optimization. The candidate will work closely with data architects, analysts, application teams, and business stakeholders to build reliable and scalable data solutions.

Responsibilities

• Design, develop, and maintain scalable data pipelines and ETL/ELT workflows using AWS services.
• Build and orchestrate data pipelines using Apache Airflow , including DAG development, scheduling, monitoring, retries, dependencies, and error handling.
• Develop data processing and transformation solutions using Python and PySpark .
• Design and implement data warehouse solutions using Snowflake .
• Develop complex SQL queries, stored procedures, views, CTEs, and data transformations .
• Work with AWS services such as S3, Glue, Lambda, EMR, Athena, Redshift, and IAM .
• Build batch and, where required, near-real-time data ingestion pipelines.
• Implement data ingestion from APIs, databases, files, and other source systems into AWS/Snowflake.
• Perform Snowflake performance and cost optimization , including warehouse sizing, query optimization, clustering, partitioning, and efficient data loading.
• Implement Snowflake features such as Snowpipe, Streams, Tasks, stages, file formats, and secure data sharing .
• Develop scalable Spark/ PySpark jobs and optimize transformations, joins, partitioning, caching, and resource utilization.
• Implement data quality checks, validation, reconciliation, and monitoring mechanisms.
• Troubleshoot pipeline failures, data issues, performance bottlenecks, and production incidents.
• Follow best practices for data security, governance, access control, and PII-sensitive data handling .
• Use Git and CI/CD practices for source control, automated testing, and deployment of data pipelines.
• Collaborate with cross-functional teams in an Agile/Scrum environment.
• Create technical documentation for data pipelines, workflows, data models, and operational procedures.

Mandatory Skill sets

• 4-8 years of experience in Data Engineering.
• Strong hands-on experience with AWS Data Engineering .
• Strong experience with Snowflake .
• Hands-on experience with Apache Airflow and DAG development.
• Strong programming experience in Python .
• Strong hands-on experience with PySpark / Apache Spark .
• Advanced SQL skills.
• Strong understanding of ETL/ELT and data pipeline development .
• Experience working with AWS S3 and AWS Glue .
• Good understanding of data warehousing and dimensional data modeling .
• Experience with data pipeline monitoring, debugging, and performance optimization.
• Good understanding of Git and CI/CD .

Cloud AWS AWS Services S3, Glue, Lambda, EMR, Athena, Redshift, IAM Data Warehouse Snowflake Programming Python Big Data PySpark , Apache Spark Orchestration Apache Airflow Database SQL, Relational Databases Data Engineering ETL/ELT, Data Pipelines, Data Integration Data Modeling Star Schema, Snowflake Schema, Dimensional Modeling DevOps Git, CI/CD Optional Kafka, dbt , Terraform, Databricks

Education

Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related discipline.

Preferred Skill sets

• AWS Lambda, EMR, Athena, Redshift, Kinesis, Step Functions, IAM .
• Snowflake Snowpipe, Streams, Tasks, Dynamic Tables, Time Travel and performance tuning .
• Experience with dbt .
• Experience with Kafka or other streaming technologies.
• Experience with Terraform / Infrastructure as Code .
• Experience with data quality tools such as Great Expectations .
• Knowledge of Lakehouse / Medallion Architecture .
• Experience with Databricks .
• Snowflake certification such as SnowPro Core .
• Exposure to Docker/Kubernetes is a plus.

Years of experience required: 4-8 Years

Education qualification: B.Tech/MCA/BCA/M.tech

Education (if blank, degree and/or field of study not specified)

Degrees/Field of Study required: Master of Engineering, Bachelor of Engineering

Degrees/Field of Study preferred: Certifications (if blank, certifications not specified)

Required Skills Data Engineering

Optional Skills Accepting Feedback, Accepting Feedback, Active Listening, Algorithm Development, Alteryx (Automation Platform), Analytical Thinking, Analytic Research, Big Data, Business Data Analytics, Communication, Complex Data Analysis, Conducting Research, Creativity, Customer Analysis, Customer Needs Analysis, Dashboard Creation, Data Analysis, Data Analysis Software, Data Collection, Data-Driven Insights, Data Integration, Data Integrity, Data Mining, Data Modeling, Data Pipeline {+ 38 more}

Desired Languages (If blank, desired languages not specified)

Travel Requirements

Available for Work Visa Sponsorship?

Government Clearance Required?

Job Posting End Date May 11, 2026

Experience Level Senior Level