GCP Data Engineer

Purview Services; Chandigarh; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Purview Services is seeking a Data Engineer to design and build scalable data pipelines on Google Cloud Platform, leveraging BigQuery, Pub/Sub and Cloud Storage to deliver reliable data services.

You will collaborate with product and analytics teams to translate business requirements into high-performance data architectures, ensure data quality and security, and optimize storage and processing for cost and efficiency.

Qualifications

• Strong understanding of GCP services including BigQuery, Pub/Sub, Cloud Storage, and Dataflow.
• Experience with data modeling, data warehousing, and ETL processes.
• Proficiency in programming languages such as Python or Java.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a team environment.
• Strong communication skills to effectively communicate technical information to non-technical stakeholders.

Responsibilities

• Design and develop scalable data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.
• Develop and maintain large-scale data systems, ensuring high availability, scalability, and performance.
• Troubleshoot complex technical issues related to data processing and analysis.
• Implement data security measures to ensure compliance with organizational standards.
• Optimize data storage and retrieval processes for improved efficiency.

Skills

ETL processes

Data warehousing

Data modeling

Collaboration

Problem-solving

Communication

Tools

BigQuery

Pub/Sub

Cloud Storage

Dataflow

Python

Java

Job description

Roles and Responsibility

• Design and develop scalable data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.


• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.


• Develop and maintain large-scale data systems, ensuring high availability, scalability, and performance.


• Troubleshoot complex technical issues related to data processing and analysis.


• Implement data security measures to ensure compliance with organizational standards.


• Optimize data storage and retrieval processes for improved efficiency.

Job Requirements

• Strong understanding of GCP services including BigQuery, Pub/Sub, Cloud Storage, and Dataflow.


• Experience with data modeling, data warehousing, and ETL processes.


• Proficiency in programming languages such as Python or Java.


• Excellent problem-solving skills and attention to detail.


• Ability to work collaboratively in a team environment.


• Strong communication skills to effectively communicate technical information to non-technical stakeholders.