GCP Senior Data Engineer

Purview Services; Ghaziabad District; On-site; INR 1,200,000 - 1,600,000; Full time

Job summary

Purview Services is seeking a data engineer to design and implement large-scale data pipelines on Google Cloud Platform. The role will involve building robust data models and architectures, ensuring data quality, and collaborating with cross-functional teams to align project requirements.

You will work with BigQuery, Pub/Sub, and Cloud Storage, apply testing and validation frameworks, and optimize storage and retrieval for performance and scalability.

Qualifications

• Strong understanding of data engineering principles and experience with GCP services.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment with multiple stakeholders.
• Strong communication and interpersonal skills to effectively interact with technical and non-technical audiences.

Responsibilities

• Design, develop, and implement large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain complex data models and architectures on GCP.
• Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
• Optimize data storage and retrieval processes for performance and scalability.
• Provide technical guidance and support to junior team members on GCP best practices.

Skills

GCP data engineering

Big data technologies

Python/Java/Scala

Communication skills

Team collaboration

Tools

Hadoop

Spark

NoSQL databases

Job description

Roles and Responsibility

• Design, develop, and implement large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain complex data models and architectures on GCP.
• Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
• Optimize data storage and retrieval processes for performance and scalability.
• Provide technical guidance and support to junior team members on GCP best practices.

Job Requirements

• Strong understanding of data engineering principles and experience with GCP services.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment with multiple stakeholders.
• Strong communication and interpersonal skills to effectively interact with technical and non-technical audiences.