IN-Senior Associate_ Data Engineering_ Data & Analytics _ Advisory _Bangalore

PwC South Africa; Bengaluru; On-site; Confidential; Full time

Job summary

PwC Bangalore is seeking a Senior Associate – Data Engineering to design, build, and scale data pipelines and architectures. You will lead a team of data engineers and work with stakeholders to translate business needs into technical solutions.

You will apply Spark, PySpark, Python, and data warehousing concepts, ensure data quality and security, and drive best practices across projects. The role is on-site in Bangalore with cloud exposure.

Qualifications

• Proven track record designing scalable data pipelines.
• Hands-on experience with Spark, PySpark, and Python.
• Strong knowledge of data warehousing and ETL.
• Excellent problem-solving and leadership abilities.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures using Spark, PySpark, and Python.
• Lead and manage a team of data engineers with mentorship and performance management.
• Collaborate with cross-functional teams to deliver high-quality data solutions.
• Ensure data quality, integrity, and security across projects.
• Implement best practices including code reviews, testing, and documentation.
• Stay up to date with industry trends in data engineering and cloud computing.
• Translate business needs into technical requirements.
• Manage timelines, resources, and budgets for data projects.

Skills

Data pipeline design

Spark / PySpark

Python

Data warehousing

ETL processes

Leadership

Communication

Tools

Databricks

Azure Data Factory

AWS

BigQuery

Redshift

Docker

Kubernetes

Job description

Senior Associate – Data Engineering

Location: Bangalore | Type: Full Time | Experience: 5–8 Years

We provide an opportunity to help organizations uncover enterprise insights and drive business results through smarter data analytics. The role focuses on business intelligence, data management, and data assurance to help clients drive innovation, growth, and change.

Responsibilities

• Design, develop, and maintain scalable data pipelines and architectures using Spark, PySpark, and Python.
• Lead and manage a team of data engineers, providing technical guidance, mentorship, and performance management.
• Collaborate with cross‑functional teams to understand data requirements and deliver high‑quality data solutions.
• Ensure data quality, integrity, and security across all data engineering projects.
• Implement best practices for data engineering, including code reviews, testing, and documentation.
• Stay up to date with the latest industry trends and technologies in data engineering and cloud computing.
• Work closely with stakeholders to translate business needs into technical requirements.
• Manage project timelines, resources, and budgets to ensure successful delivery of data engineering projects.

Required Skills

• Proven track record of designing and building scalable data pipelines and architectures.
• Hands‑on experience with data processing and transformation using Spark, PySpark, and Python.
• Strong understanding of data warehousing concepts and ETL processes.
• Excellent problem‑solving skills and the ability to troubleshoot complex technical issues.
• Strong leadership and team management skills.
• Effective communication skills, both written and verbal.

Preferred Qualifications

• Experience with cloud‑native data engineering on platforms such as Databricks, Azure Data Engineering, or AWS.
• Familiarity with cloud services related to data storage, processing, and analytics (e.g., BigQuery, Redshift, S3, EMR).
• Knowledge of containerization and orchestration technologies (e.g., Docker, Kubernetes).
• Experience with data visualization tools and techniques.
• Familiarity with machine learning and data science concepts.

Certifications

Mandatory: Spark 3.0 or Databricks Advanced/Professional Architect. Optional: industry certifications related to data engineering or cloud platforms are a plus.

Equal Employment Opportunity Statement

At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth.