Senior Associate _GCP Data Engineer

Pricewaterhouse Coopers Private Limited; Bengaluru; On-site; INR 6,00,000 - 10,00,000; Full time

Job summary

An established industry player is seeking a skilled Data Engineer to design and implement efficient data pipelines on Google Cloud Platform. This role involves collaborating with cross-functional teams to deliver actionable data solutions, developing ETL/ELT processes, and ensuring data governance and compliance. You'll optimize data processing jobs and stay updated with GCP services to recommend improvements. If you're passionate about data and eager to contribute to innovative analytics initiatives, this opportunity is perfect for you.

Qualifications

• Experience in designing and implementing scalable data pipelines.
• Proficiency in GCP tools for data processing and analytics.

Responsibilities

• Design and implement secure data pipelines on GCP.
• Collaborate with teams to deliver actionable data solutions.

Skills

GCP

BigQuery

Dataflow

Dataproc

Airflow

Job description

• Design and implement scalable, efficient, and secure data pipelines on GCP, utilizing tools such as BigQuery, Dataflow, Dataproc, Pub/Sub, and Cloud Storage.
• Collaborate with crossfunctional teams (data scientists, analysts, and software engineers) to understand business requirements and deliver actionable data solutions.
• Develop and maintain ETL/ELT processes to ingest, transform, and load data from various sources into GCPbased data warehouses.
• Build and manage data lakes and data marts on GCP to support analytics and business intelligence initiatives.
• Implement automated data quality checks, monitoring, and alerting systems to ensure data integrity.
• Optimize and tune performance for largescale data processing jobs in BigQuery, Dataflow, and other GCP tools.
• Create and maintain data pipelines to collect, clean, and transform data for analytics and machine learning purposes.
• Ensure data governance and compliance with organizational policies, including data security, privacy, and access controls.
• Stay up to date with new GCP services and features and make recommendations for improvements and new implementations.

Mandatory skill sets

GCP, Big query , Data Proc

Preferred skill sets

GCP, Big query , Data Proc, Airflow