GCP Senior Data Engineer

Purview Services; Chennai District; On-site; INR 1,200,000 - 1,800,000; Full time

Job summary

Purview Services in Chennai District, India, seeks a data engineer to design, develop, and maintain large-scale data pipelines on Google Cloud Platform. The role emphasizes building robust data models, optimizing storage, and ensuring quality through testing and validation frameworks.

The candidate will collaborate with cross-functional teams, leverage BigQuery, Pub/Sub, and Cloud Storage, and guide junior engineers in GCP best practices to deliver scalable data solutions.

Qualifications

• Strong understanding of data engineering principles.
• Experience with GCP services.
• Experience with Hadoop, Spark, and NoSQL databases.
• Proficiency in Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.

Responsibilities

• Design, develop, and implement large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain complex data models and architectures on GCP.
• Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
• Optimize data storage and retrieval processes for performance and scalability.
• Provide technical guidance and support to junior team members on GCP best practices.

Skills

GCP services

Data engineering

Python/Java/Scala

Big data technologies

Communication

Tools

Hadoop

Spark

NoSQL databases

Python

Java

Scala

Job description

Roles and Responsibility

• Design, develop, and implement large-scale data pipelines using GCP services such as BigQuery, Pub/Sub, and Cloud Storage.
• Collaborate with cross-functional teams to identify and prioritize project requirements.
• Develop and maintain complex data models and architectures on GCP.
• Ensure high-quality data processing and analysis by implementing robust testing and validation frameworks.
• Optimize data storage and retrieval processes for performance and scalability.
• Provide technical guidance and support to junior team members on GCP best practices.

Job Requirements

• Strong understanding of data engineering principles and experience with GCP services.
• Experience with big data technologies such as Hadoop, Spark, and NoSQL databases.
• Proficiency in programming languages such as Python, Java, or Scala.
• Excellent problem-solving skills and attention to detail.
• Ability to work collaboratively in a fast-paced environment with multiple stakeholders.
• Strong communication and interpersonal skills to effectively interact with technical and non-technical audiences.