Senior Data Engineer/Associate - GCP - Snowflake - DBT

PwC; Kolkata District, Hyderabad, Bengaluru; Hybrid; INR 1,200,000 - 1,800,000; Full time

Job summary

PwC is seeking a data engineer to develop and implement data engineering solutions using Snowflake, DBT, and GCP to support client modernization efforts.

You will manage data pipelines, optimize performance with Airflow and Azure Data Factory, and build scalable architectures integrating data from AWS and Databricks.

Qualifications

• Bachelor's degree required.
• At least 4 years of experience in data engineering.
• Oral and written proficiency in English required.

Responsibilities

• Develop and implement data engineering solutions using Snowflake, DBT and GCP.
• Manage data pipelines and optimize database performance with Airflow and Azure Data Factory.
• Build scalable data architectures and integrate data from AWS and Databricks.

Skills

Snowflake

DBT

GCP

Airflow

Azure Data Factory

Databricks

AWS

PostgreSQL

MySQL

Data Modeling

Dimensional Modeling

Data Warehousing

SQL

English Proficiency

Education

Bachelor's degree

Tools

Snowflake Data Warehouse

DBT

Apache Airflow

Azure Data Factory

AWS

Databricks

GCP

Job description

Role & responsibilities

Responsibilities

• Developing and implementing data engineering solutions using Snowflake, DBT, and GCP to support client data modernization initiatives
• Managing data pipelines and optimizing database performance through tools like Apache Airflow and Azure Data Factory
• Building scalable data architectures and integrating data from various sources, including Amazon Web Services (AWS) and Databricks Unified Data Analytics Platform
• Conducting data validation and transformation processes to maintain data quality and integrity
• Utilizing analytical thinking to troubleshoot data warehouse issues and enhance data warehouse indexing
• Collaborating with teams to design and execute data strategies that align with business objectives
• Applying dimensional modeling techniques to improve data organization and accessibility
• Leveraging knowledge of database management systems, including MySQL and PostgreSQL, for efficient data storage and retrieval
• Confirming database security best practices to protect sensitive information and maintain compliance
• Guiding junior team members in data engineering practices and fostering a collaborative work environment

What You Must Have

• At least a Bachelor's degree
• At least 4 years of experience
• Oral and written proficiency in English required

What Sets You Apart

• Preference for at least one of the following fields of study: Management Information Systems, Computer and Information Science, Systems Engineering, Electrical Engineering, Chemical Engineering, Industrial Engineering, Mathematics, Statistics, Mathematical Statistics
• Demonstrating proficiency in Snowflake Data Warehouse and Schema
• Utilizing Apache Airflow for data pipeline orchestration
• Leveraging Amazon Web Services (AWS) and Microsoft Azure Databricks
• Developing data architecture and integration strategies
• Excelling in data modeling and dimensional modeling
• Applying analytical thinking to solve complex data challenges