Walk-in | Google data engineer

Tata Consultancy Services; Hyderabad; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Tata Consultancy Services is seeking an experienced Google Data Engineer to design, develop, and maintain large-scale data processing systems on Google Cloud Platform (GCP). The role requires a strong background in data engineering, data warehousing, and cloud-based platforms.

Responsibilities include building data pipelines with Dataflow, implementing data warehousing with BigQuery, establishing data governance, and cost optimization, while collaborating across teams to ensure data quality and

Qualifications

• 5-10 years of hands-on experience in data engineering on GCP.
• Experience designing large-scale data processing systems and data warehousing.
• Proficiency in ETL, data modeling, and data quality governance.
• Strong programming skills in Python, Java, or SQL.

Responsibilities

• Design, develop, and maintain data pipelines using GCP tools.
• Design and implement data warehousing solutions with BigQuery.
• Develop data governance policies, procedures, and standards for GCP.
• Collaborate with cross-functional teams to ensure data quality.
• Optimize GCP costs and improve processing efficiency.

Skills

Google Cloud Platform

Data Engineering

Data Warehousing

ETL

Data Modeling

BigQuery

Cloud Dataflow

Cloud Composer

Cloud Storage

Pub/Sub

Python/Java/SQL

Data Governance

Communication

Tools

BigQuery

Cloud Dataflow

Cloud Composer

Cloud Storage

Dataproc

Cloud Functions

Pub/Sub

Job description

Job Title: Google Data Engineer

Experience: 5-10 years

Job Summary

An experienced Google Data Engineer / Lead to design, develop, and maintain large-scale data processing systems on Google Cloud Platform (GCP). The ideal candidate should have a strong background in data engineering, data warehousing, and cloud-based data platforms.

Responsibilities

• Data Pipeline Development: Design, develop, and maintain data pipelines using Google Cloud Dataflow, Cloud Composer, and BigQuery.
• Data Warehousing: Work with data architects and business stakeholders to design and implement data warehousing solutions using BigQuery and Cloud Storage.
• Data Governance: Develop and maintain data governance policies, procedures, and standards for GCP.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance, and ensure data quality.
• Cost Optimization: Optimize GCP costs and ensure data processing efficiency.

Required Skills

• Google Cloud Platform: In-depth knowledge of GCP, including Cloud Dataflow, BigQuery, Cloud Storage, and Cloud Composer.
• Data Engineering: Strong understanding of data engineering concepts, including data modeling, ETL, and data warehousing.
• Expertise in Cloud storage, Dataproc, Cloud Functions, Messaging/Streaming (pub-sub)
• Programming: Proficiency in programming languages, including Python, Java, or SQL.
• Data Governance: Familiarity with data governance frameworks, including data quality, data security, and data compliance.
• Communication: Excellent communication and collaboration skills.

Preferred Skills

• Google Cloud Certifications: Relevant certifications, such as Google Cloud Certified - Professional Data Engineer or Google Cloud Certified - Enterprise Data Engineer.
• Big Data: Experience with big data technologies, including Hadoop, Spark, or NoSQL databases.
• Machine Learning: Experience with machine learning frameworks, including TensorFlow or Scikit-learn.
• Cloud Experience*: Experience with other cloud-based data platforms, including AWS or Azure