Data Engineer - Senior Associate

PwC Acceleration Center India; Bengaluru; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

PwC Acceleration Center India seeks a Senior Data Engineer to design scalable data pipelines and analytics solutions across geographies, using Spark, Python, SQL and modern data platforms. You will work within Advisory and Tax teams to build cloud-native data solutions and AI-enabled products.

The role emphasizes data modeling, CI/CD, testing, and collaboration to deliver quality deployments while growing technical and leadership skills in a global organization.

Qualifications

• Bachelor’s degree or equivalent experience.
• 5–8 years of relevant data engineering experience.

Responsibilities

• Design and build scalable data pipelines, data products and analytics with Spark, Python and SQL.
• Develop and optimize data engineering on cloud platforms and lakehouse architectures.
• Collaborate with cross‑functional teams to translate requirements into robust data solutions.

Skills

LangChain

LangGraph

AutoGen

Semantic Kernel

LLMs

Vector databases

Semantic search

AI solution evaluation

Spark

Python

SQL

Databricks

Azure

Education

Bachelor’s degree or equivalent experience

Tools

Databricks

Microsoft Fabric

Snowflake

Sigma

Job description

The Opportunity

Join our Acceleration Center India and help shape the future of business for our diverse client portfolio across geographies and jurisdictions. You’ll work at the heart of global teams across Advisory, Assurance, Tax and Business Services—solving real client challenges through connected collaboration. We’ll help you grow your skills so you can go further. With hands‑on learning, cutting‑edge tools and an inclusive culture, this is your opportunity to do inspiring work that makes a difference—every day.

As a Data Engineer - Senior Associate, you will play a pivotal role in developing innovative software solutions to drive digital transformation and enhance business performance. Within our Advisory - Other practice, you will focus on designing, coding, and testing applications that revolutionize industries and deliver exceptional user experiences. As a Senior Associate, you will build meaningful client connections and learn how to manage and inspire others. You will navigate increasingly complex situations, growing your personal brand and deepening your technical skills. You are expected to anticipate the needs of your teams and clients, delivering quality work even when the path forward isn’t clear.

In this role at PwC Acceleration Center India, you will leverage your technical experience and creative thinking to deliver software products and solutions that meet the evolving needs of clients. You will use a broad range of tools and methodologies to generate new ideas and solve problems, while upholding professional and technical standards. This is an opportunity to develop a deeper understanding of the business context and how it is changing, using reflection to enhance your strengths and address development areas.

Responsibilities

• Design and build scalable data pipelines, data products, and analytics solutions using Spark, Python, SQL, and modern data engineering frameworks.


• Develop and optimize data engineering solutions on modern cloud data platforms and lakehouse architectures, such as Databricks, Microsoft Fabric, Snowflake, Sigma, or similar enterprise data platforms.


• Build cloud-native data solutions using Azure services, including Azure Cloud, Azure DevOps, Azure Storage, and Azure Data Services.


• Apply data modeling techniques and architectural patterns including data lake, lakehouse, Delta Lake, and data warehouse solutions.


• Implement CI/CD pipelines, automated testing, and version control practices to enable fast, reliable deployments.


• Design and support distributed data processing solutions using Apache Spark and related frameworks.


• Collaborate with cross-functional teams to translate business and user requirements into robust data engineering solutions.


• Support AI-enabled delivery by applying machine learning techniques, Retrieval-Augmented Generation (RAG), agentic AI frameworks, and modern AI engineering practices.


• Leverage platform-native AI capabilities to improve data access, analytics, automation, and solution delivery.


• Ensure data solutions are reliable, scalable, secure, and aligned with Tax Innovation standards and delivery methodology.


• Champion continuous improvement across data engineering practices, workflows, and delivery processes.


• Stay current with emerging data, AI, cloud, and platform capabilities that can transform how the Tax Innovation Data team delivers work.

What You Must Have

• Bachelor’s degree or equivalent experience.


• 5 to 8 years of relevant experience in data engineering or related technology roles.

What Sets You Apart

• Experience with agentic AI frameworks such as LangChain, LangGraph, AutoGen, Semantic Kernel, or similar technologies.


• Strong understanding of Large Language Models (LLMs), prompt engineering, vector databases, semantic search, embeddings, and AI solution evaluation frameworks.


• Experience delivering AI-enabled data products that combine structured and unstructured data to improve business outcomes.


• Experience improving data solution quality through testing, performance tuning, monitoring, and operational readiness.


• Demonstrated ability to translate business needs into practical, reusable, and standardized data engineering solutions.


• Curiosity for emerging data, AI, cloud, and automation technologies, with a mindset for continuous learning and innovation.


• Experience using AI-enabled tools to improve engineering productivity and streamline delivery workflows.


• Strong collaboration skills and enthusiasm for contributing to the Tax Innovation Data team's transformation agenda.