GCP Senior Data Engineer

Purview Services; Kolkata District; On-site; INR 900,000 - 1,400,000; Full time

Job summary

Purview Services seeks a skilled Data Engineer to design and implement large-scale data pipelines on Google Cloud Platform. You will build robust data models and architectures, ensure data quality through testing, and optimize storage for performance at scale.

You will collaborate with cross-functional teams to prioritize requirements, mentor juniors, and apply best practices for GCP workflows in a fast-paced environment.

Qualifications

• Strong understanding of data engineering principles and experience with GCP services.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment with multiple stakeholders.
• Strong communication and interpersonal skills to effectively interact with technical and non-technical audiences.

Responsibilities

• Design, develop, and implement large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain complex data models and architectures on GCP.
• Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
• Optimize data storage and retrieval processes for performance and scalability.
• Provide technical guidance and support to junior team members on GCP best practices.

Skills

GCP services

BigQuery

Pub/Sub

Cloud Storage

Python

Java

Scala

Hadoop

Spark

NoSQL databases

Data modeling

Data engineering principles

Tools

Airflow

Git

Dataflow

Job description

Roles and Responsibility

• Design, develop, and implement large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain complex data models and architectures on GCP.
• Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
• Optimize data storage and retrieval processes for performance and scalability.
• Provide technical guidance and support to junior team members on GCP best practices.

Job Requirements

• Strong understanding of data engineering principles and experience with GCP services.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment with multiple stakeholders.
• Strong communication and interpersonal skills to effectively interact with technical and non-technical audiences.