Senior Associate - Azure -AWS- Databricks -Agentic AI & Python

PwC; Kolkata District, Hyderabad, Bengaluru; Hybrid; INR 1,800,000 - 2,400,000; Full time

Job summary

PwC Acceleration Centers Bangalore is seeking a Senior Associate in Data Engineering to design and deliver scalable, cloud-based data solutions. You will apply expertise in AWS, Snowflake, Hadoop, Spark, and ETL pipelines to translate complex requirements into robust designs.

You will mentor peers, collaborate with stakeholders, and contribute to continuous improvement while working in a dynamic technology consulting environment.

Qualifications

• Experience in architecting and delivering scalable, distributed, cloud-based enterprise data solutions.
• End-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWS, AI & Python.
• Hands-on experience with Snowflake utilities and ETL pipelines, data modeling techniques.
• Proficiency in Python/Java; loads disparate data sets and translates requirements into designs.
• Awareness of Snowflake features such as data sharing, lake-house patterns; strong SQL skills.
• Deep understanding of relational and NoSQL data stores; star/snowflake dimensional modeling.
• Strong AWS hands-on expertise with Python/Scala; knowledge of EMR, Glue, Sagemaker, S3, Redshift, DynamoDB.
• Big data frameworks like Hadoop and Spark; Spark performance tuning; Spark SQL/Streaming.
• Experience with flow tools like Airflow, Nifi, or Luigi; DevOps tools and CI/CD.

Responsibilities

• Design and implement scalable cloud-based data solutions for clients.
• Apply data engineering knowledge to solve complex technical issues.
• Mentor team members and drive technical growth.
• Collaborate with stakeholders to ensure project success.
• Analyze data to inform strategic decisions and maintain deliverable quality.
• Adapt to evolving technologies and contribute to process improvements.

Skills

Cloud data solutions

Snowflake

ETL pipelines

Python/Java

AWS (EMR, Glue, Sagemaker)

Hadoop & Spark

Data modeling (star/snowflake)

DevOps tools (Git, CI/CD)

Airflow/Nifi/Luigi

Spark Streaming

Snowflake features (data sharing, lake

SnowSQL/SnowPipe

Education

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA

Tools

Snowflake utilities

SnowSQL

SnowPipe

ETL pipelines

Airflow

Nifi

Luigi

Jenkins

Git/Gitlab/Code Pipeline

Code Build/Code Commit

AWS CloudWatch/CloudTrail/Config

Job description

Role & responsibilities

Position Requirements:

Must Have:

• Experience in architecting and delivering highly scalable, distributed, cloud-based enterprise data solutions
• Strong expertise in the end-to-end implementation of Cloud data engineering solutions like Enterprise Data Lake, Data hub in AWS, AI & Python
• Hands-on experience with Snowflake utilities, SnowSQL, SnowPipe,ETL data Pipelines, Big Data model techniques using
• Python / Java
• Experience in loading disparate data sets and translating complex functional and technical requirements into detailed design
• Should be aware of deploying Snowflake features such as data sharing, events and lake-house patterns
• Deep understanding of relational as well as NoSQL data stores, methods and approaches (star and snowflake, dimensional modeling)
• Strong AWS hands-on expertise with a programming background preferably Python/Scala
• Good knowledge of Big Data frameworks and related technologies
• Experience in Hadoop and Spark is mandatory
• Strong experience in AWS compute services like AWS EMR, Glue and Sagemaker and storage services like S3, Redshift & Dynamodb
• Good experience with any one of the AWS Streaming Services like AWS Kinesis, AWS SQS and AWS MSK
• Troubleshooting and Performance tuning experience in Spark framework
• Spark core, Sql and Spark Streaming
• Experience in one of the flow tools like Airflow, Nifi or Luigi
• Good knowledge of Application DevOps tools (Git, CI/CD Frameworks)
• Experience in Jenkins or Gitlab with rich experience in source code management like Code Pipeline, Code Build and Code Commit
• Experience with AWS CloudWatch, AWS Cloud Trail, AWS Account Config, AWS Config Rules
• Strong understanding of Cloud data migration processes, methods and project lifecycle
• Good analytical & problem-solving skills
• Good communication and presentation skills

Desired Knowledge / Skills:

• Experience in building stream-processing systems, using solutions such as Storm or Spark
• Streaming
• Experience in Big Data ML toolkits, such as Mahout, SparkML, or H2O
• Knowledge in Python
• Worked in Offshore / Onsite Engagements
• Experience in one of the flow tools like Airflow, Nifi or Luigi
• Experience in AWS services like STEP & Lambda

Professional and Educational Background:

BE / B.Tech / MCA / M.Sc / M.E / M.Tech / MBA

Additional Information:

Travel Requirements:

Travel to client locations may be required as per project requirements.

Line of Service:

Advisory

Horizontal:

Technology Consulting

Designation:

Associate

Location:

Bangalore, India

The Opportunity

• When you join PwC Acceleration Centers (ACs), you step into a pivotal role focused on actively supporting various Acceleration Center services, from Advisory to Assurance, Tax and Business Services. In our innovative hubs, youll engage in challenging projects and provide distinctive services to support client engagements through enhanced quality and innovation. You’ll also participate in dynamic and digitally enabled training that is designed to grow your technical and professional skills.
• As part of the Data Engineering team you will architect and deliver scalable, cloud-based enterprise data solutions. As a Senior Associate, you will leverage your knowledge in data engineering to navigate complexity and deliver elevated solutions while mentoring others and enhancing your technical skills.

Responsibilities

• Design and implement scalable cloud-based data solutions
• Utilize data engineering knowledge to solve complex issues
• Mentor team members to foster technical growth
• Collaborate with stakeholders to secure project success
• Analyze data to inform strategic decisions
• Maintain exceptional standards in deliverables
• Adapt to evolving technologies and methodologies
• Contribute to continuous improvement initiatives

What You Must Have

• Bachelor's Degree
• 4 years of experience
• Oral and written proficiency in English required

What Sets You Apart

• 4-8 years of experience in cloud data solutions
• Experience in architecting scalable cloud-based data solutions
• Skilled in Snowflake utilities and ETL data pipelines
• Understanding of data security and access controls
• Familiarity with AWS compute and storage services
• Experience with Big Data frameworks like Hadoop and Spark
• Knowledge of application DevOps tools and CI/CD frameworks
• Experience in building stream-processing systems
• Worked in offshore and onsite engagements