Aws Data Engineer-Senior Associate

PwC; Kolkata District, Hyderabad, Bengaluru; Hybrid; INR 1,500,000 - 2,100,000; Full time

Job summary

PwC India seeks an experienced data engineer to design and build scalable data platforms in production environments. You will own end-to-end data pipelines, optimize SQL queries, and implement PySpark transformations on large datasets.

Key skills include strong Python programming, AWS Glue, Lambda, Redshift, Databricks Unity Catalog, and IaC with CloudFormation. Experience with Claude/ChatGPT for code generation is a plus; join a collaborative, client-focused team.

Qualifications

• 6+ years of hands-on data engineering in production environments.
• 3+ years with AWS cloud services: Glue ETL, Lambda, and Redshift.
• 2+ years with Databricks: Unity Catalog governance and notebook development.
• Proficient in SQL with complex queries, optimization, and window functions.
• Strong Python programming with production-grade code.
• Advanced PySpark for distributed data processing.
• Hands-on IAM with Infrastructure as Code (CloudFormation).
• Experience using AI tools (Claude, ChatGPT) for code generation and documentation.

Skills

Data engineering

SQL

Python

PySpark

Tools

AWS Glue

AWS Lambda

Amazon Redshift

Databricks

Unity Catalog

Databricks Notebook

CloudFormation

Claude

ChatGPT

Job description

• 6+ years of hands‑on data engineering experience in production environments
• 3+ years of hands‑on experience with AWS cloud services, specifically:

AWS Glue ETL job development and optimization

AWS Lambda – Serverless function development and integration

Amazon Redshift – Data warehouse design and SQL query optimization

• 2+ years of hands‑on experience with Databricks, including:

Unity Catalog implementation and governance

Databricks notebook development and optimization

• Proficiency in SQL with expertise in complex queries, optimization, and window functions
• Strong Python programming skills with hands‑on experience in production code
• Advanced PySpark skills for distributed data processing and transformation
• Hands‑on experience with Infrastructure as Code tools:

CloudFormation (CFT) – AWS infrastructure templates

• Practical experience with AI tools (Claude, ChatGPT) for code generation, documentation, and problem‑solving