GCP Data Engineer

Tata Consultancy Services Limited; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

Tata Consultancy Services Limited in Bengaluru seeks an experienced GCP Data Engineer to design, develop, and maintain scalable data solutions on Google Cloud Platform. You will build modern data pipelines, data warehousing, and cloud-native analytics while aligning with business stakeholders.

Collaborate with data architects, scientists, and application teams to deliver reliable platforms. Proficiency in BigQuery, Dataflow, and Python is essential, as is a focus on data quality, governance, and

Qualifications

• Bachelor's or Master's in Computer Science or equivalent.
• Strong experience designing data pipelines on GCP (BigQuery, Dataflow).
• Experience with data warehousing and cloud-native analytics.

Responsibilities

• Design, develop, and optimize scalable data pipelines using GCP services.
• Build and maintain batch and real-time data ingestion and processing frameworks.
• Develop enterprise-grade data warehousing solutions using BigQuery.
• Implement ETL/ELT processes for structured and unstructured data.
• Integrate data from multiple sources including databases, APIs, files, and streaming platforms.
• Ensure data quality, governance, security, and compliance across data platforms.
• Optimize query performance, storage, and processing costs within GCP.
• Automate deployment and operational processes using CI/CD and IaC.
• Monitor data pipelines and troubleshoot production issues.
• Collaborate with Data Architects, Business Analysts, and Data Scientists to translate business requirements into technical solutions.
• Implement data models, metadata management, and data lineage best practices.
• Support migration of on-premise or multi-cloud data platforms to GCP.
• Mentor junior engineers and participate in technical design reviews.

Skills

Data pipelines

Data warehousing

Cloud analytics

Stakeholder collaboration

Education

Bachelor's/Master’s in Computer Science

Tools

BigQuery

Cloud Composer

Dataflow

Pub/Sub

Cloud Functions

BigLake

Vertex AI

Python

SQL

PySpark

Job description

Job Requirements

We are seeking an experienced GCP Data Engineer to design, develop, and maintain scalable data solutions on the Google Cloud Platform (GCP). The ideal candidate will have strong expertise in building modern data pipelines, data warehousing, big data processing, and cloud-native analytics solutions. The role requires close collaboration with business stakeholders, data architects, data scientists, and application teams to deliver reliable and high-performance data platforms.

Key Responsibilities*

• Design, develop, and optimize scalable data pipelines using GCP services.
• Build and maintain batch and real-time data ingestion and processing frameworks.
• Develop enterprise-grade data warehousing solutions using BigQuery.
• Implement ETL/ELT processes for structured and unstructured data.
• Integrate data from multiple sources including databases, APIs, files, and streaming platforms.
• Ensure data quality, governance, security, and compliance across data platforms.
• Optimize query performance, storage, and processing costs within GCP.
• Automate deployment and operational processes using CI/CD and Infrastructure as Code (IaC).
• Monitor data pipelines and troubleshoot production issues.
• Collaborate with Data Architects, Business Analysts, and Data Scientists to translate business requirements into technical solutions.
• Implement data models, metadata management, and data lineage best practices.
• Support migration of on-premise or multi-cloud data platforms to GCP.
• Mentor junior engineers and participate in technical design reviews.

Required Technical Skills

• BigQuery
• Cloud Composer (Apache Airflow)
• Dataflow
• Pub/Sub
• Cloud Functions
• BigLake (preferred)
• Vertex AI integration (good to have)
• Python
• SQL (Advanced)
• PySpark

Education Requirements

Bachelor's/Master’s in Computer Science or equivalent (Preferred)