Developer - GCP

Tata Consultancy Services; Hyderabad; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Tata Consultancy Services in Hyderabad is seeking an experienced Google Data Engineer/Lead to design, develop, and maintain large-scale data processing systems on Google Cloud Platform. The role emphasizes data engineering, warehousing, and cloud-based platforms to drive scalable analytics.

You will build data pipelines with Dataflow, BigQuery, and Cloud Composer, collaborate with cross-functional teams, and optimize costs while ensuring data quality and governance.

Qualifications

• 6–12 years of relevant experience in data engineering and cloud platforms.
• Strong background in data modeling, ETL, and data warehousing on GCP.
• Excellent communication and collaboration skills.

Responsibilities

• Data Pipeline Development: Design, develop, and maintain data pipelines using Google Cloud Dataflow, Cloud Composer, and BigQuery.
• Data Warehousing: Design and implement data warehousing solutions using BigQuery and Cloud Storage.
• Data Governance: Develop and maintain data governance policies, procedures, and standards for GCP.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance and ensure data quality.
• Cost Optimization: Optimize GCP costs and ensure data processing efficiency.

Skills

GCP expertise

Data engineering

Data modeling

ETL processes

Python/Java/SQL

Data governance

Communication

Tools

BigQuery

Cloud Dataflow

Cloud Composer

Cloud Storage

Dataproc

Pub/Sub

Job description

Job Title: Google Data Engineer / Lead

Experience: 6-12 years

Job Summary: An experienced Google Data Engineer / Lead to design, develop, and maintain large-scale data processing systems on Google Cloud Platform (GCP). The ideal candidate should have a strong background in data engineering, data warehousing, and cloud-based data platforms.

Responsibilities:

• Data Pipeline Development: Design, develop, and maintain data pipelines using Google Cloud Dataflow, Cloud Composer, and BigQuery.
• Data Warehousing: Work with data architects and business stakeholders to design and implement data warehousing solutions using BigQuery and Cloud Storage.
• Data Governance: Develop and maintain data governance policies, procedures, and standards for GCP.
• Collaboration: Work with cross-functional teams to identify and prioritize project requirements, provide technical guidance and ensure data quality.
• Cost Optimization: Optimize GCP costs and ensure data processing efficiency.

Required Skills:

• Google Cloud Platform: In-depth knowledge of GCP, including Cloud Dataflow, BigQuery, Cloud Storage, and Cloud Composer.
• Data Engineering: Strong understanding of data engineering concepts, including data modeling, ETL, and data warehousing.
• Expertise in Cloud storage, Dataproc, Cloud Functions, Messaging/Streaming (pub sub)
• Programming: Proficiency in programming languages, including Python, Java, or SQL.
• Data Governance: Familiarity with data governance frameworks, including data quality, data security, and data compliance.
• Communication: Excellent communication and collaboration skills.

Preferred Skills:

• Google Cloud Certifications: Relevant certifications, such as Google Cloud Certified - Professional Data Engineer or Google Cloud Certified - Enterprise Data Engineer.
• Big Data: Experience with big data technologies, including Hadoop, Spark, or NoSQL databases.
• Machine Learning: Experience with machine learning frameworks, including TensorFlow or Scikit-learn.
• Cloud Experience*: Experience with other cloud-based data platforms, including AWS or Azure