IN_Associate_Data Engineer_Data and Analytics_Advisory_Pan India

PwC South Africa; Bengaluru; On-site; Confidential; Full time

Job summary

PwC, a leading advisory firm, is seeking a Data Engineer to design and maintain robust data ecosystems and pipelines. You will drive data-driven decision making by transforming raw data into actionable insights and building scalable infrastructure.

The role focuses on data processing, quality checks, governance, and collaboration with cross-functional teams to deliver secure and compliant data solutions for clients.

Qualifications

• Experience designing and building complex data pipelines and processing systems.
• Leadership and mentorship capabilities for junior data engineers.
• Strong data modeling and database design skills.
• Knowledge of data governance, security, and compliance.
• Familiarity with Hadoop, Spark and NoSQL technologies.

Responsibilities

• Architect and design complex data systems and pipelines.
• Lead and mentor junior data engineers.
• Collaborate with cross-functional teams to define data requirements.
• Implement data quality checks and ensure data integrity.
• Optimize data processes for efficiency and scalability.
• Oversee data security and compliance measures.
• Evaluate and recommend new data technologies.

Skills

Azure

GCP

AWS

Hadoop

Spark

NoSQL

Data modeling

Data pipelines

Data processing

Data governance

Education

BE/BTech

ME/MTech

MBA

MCA

Tools

ADF

BigQuery

AWS Glue

Snowflake

Databricks

Job description

Line of Service Advisory Industry/Sector Not Applicable Specialism Data, Analytics & AI Management Level Associate Job Description & Summary At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop robust data solutions for clients. They play a crucial role in transforming raw data into actionable insights, enabling informed decision-making and driving business growth. In data engineering at PwC, you will focus on designing and building data infrastructure and systems to enable efficient data processing and analysis. You will be responsible for developing and implementing data pipelines, data integration, and data transformation solutions.

Why PWC At PwC, you will be part of a vibrant community of solvers that leads with trust and creates distinctive outcomes for our clients and communities. This purpose-led and values-driven work, powered by technology in an environment that drives innovation, will enable you to make a tangible impact in the real world. We reward your contributions, support your wellbeing, and offer inclusive benefits, flexibility programmes and mentorship that will help you thrive in work and life. Together, we grow, learn, care, collaborate, and create a future of infinite experiences for each other. Learn more about us. At PwC, we believe in providing equal employment opportunities, without any discrimination on the grounds of gender, ethnic background, age, disability, marital status, sexual orientation, pregnancy, gender identity or expression, religion or other beliefs, perceived differences and status protected by law. We strive to create an environment where each one of our people can bring their true selves and contribute to their personal growth and the firm’s growth. To enable this, we have zero tolerance for any discrimination and harassment based on the above considerations.

Responsibilities

Job title: Data Engineer About the role: As a Junior/Senior Data Engineer, you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the organization.

• Architecting and designing complex data systems and pipelines.
• Leading and mentoring junior data engineers and team members.
• Collaborating with cross-functional teams to define data requirements.
• Implementing advanced data quality checks and ensuring data integrity.
• Optimizing data processes for efficiency and scalability.
• Overseeing data security and compliance measures.
• Evaluating and recommending new technologies to enhance data infrastructure.
• Providing technical expertise and guidance for critical data projects.

Required skills & experience

Proficiency in designing and building complex data pipelines and data processing systems. Leadership and mentorship capabilities to guide junior data engineers and foster skill development. Strong expertise in data modeling and database design for optimal performance. Skill in optimizing data processes and infrastructure for efficiency, scalability, and cost-effectiveness. Knowledge of data governance principles, ensuring data quality, security, and compliance. Familiarity with big data technologies like Hadoop, Spark, or NoSQL. Expertise in implementing robust data security measures and access controls. Effective communication and collaboration skills for cross-functional teamwork and defining data requirements.

Skills

Cloud: Azure/GCP/AWS DE Technologies: ADF, Big Query, AWS Glue etc., Data Lake: Snowflake, Data Bricks etc.

Mandatory skill sets

• Cloud: Azure/GCP/AWS
• DE Technologies: ADF, Big Query, AWS Glue etc.
• Data Lake: Snowflake, Data Bricks etc.

Preferred skill sets

• Cloud: Azure/GCP/AWS
• DE Technologies: ADF, Big Query, AWS Glue etc.
• Data Lake: Snowflake, Data Bricks etc.

Years of experience required: 2-4 years

Education qualification: BE/BTECH, ME/MTECH, MBA, MCA Education (if blank, degree and/or field of study not specified) Degrees/Field of Study required: Bachelor of Engineering, Master of Engineering, Master of Business Administration Degrees/Field of Study preferred: Certifications (if blank, certifications not specified) Required Skills AWS Glue, Microsoft Azure Optional Skills Accepting Feedback, Accepting Feedback, Active Listening, Agile Scalability, Amazon Web Services (AWS), Apache Hadoop, Azure Data Factory, Communication, Data Anonymization, Database Administration, Database Management System (DBMS), Database Optimization, Database Security Best Practices, Data Engineering, Data Engineering Platforms, Data Infrastructure, Data Integration, Data Lake, Data Modeling, Data Pipeline, Data Quality, Data Transformation, Data Validation, Data Warehouse, Data Warehouse Indexing {+ 13 more} Desired Languages (If blank, desired languages not specified)

Travel Requirements Available for Work Visa Sponsorship? Government Clearance Required? Job Posting End Date