GCP Data Engineer

Tata Consultancy Services; Chennai; On-site; INR 1,600,000 - 2,600,000; Full time

Job summary

Tata Consultancy Services in Chennai is seeking an experienced GCP Data Engineer to design, develop, and maintain scalable data platforms on Google Cloud.

You will build ETL/ELT pipelines with BigQuery, Dataflow, Dataproc, and Cloud Storage, ingesting structured and unstructured data, and collaborating with data scientists and analysts.

Qualifications

• 6-10 years of overall IT experience.
• Strong experience with Google Cloud Platform (GCP).
• Hands-on experience with BigQuery.
• Hands-on experience with Dataflow.
• Hands-on experience with Pub/Sub.
• Experience in building ETL/ELT pipelines.
• Knowledge of Python or Java for data engineering.
• Understanding of data warehousing and data lake concepts.
• Experience with Git and CI/CD processes.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and maintain data processing solutions using BigQuery, Dataflow, Dataproc, and Cloud Storage.
• Develop and optimize data ingestion and transformation frameworks.
• Work with structured and unstructured data from multiple sources.
• Collaborate with Data Scientists, Analysts, and Business teams to support data requirements.
• Implement data quality, governance, security, and monitoring processes.
• Troubleshoot performance issues and optimize data workflows.
• Follow CI/CD and DevOps best practices for deployment and maintenance.

Skills

GCP

ETL/ELT pipelines

Data warehousing / data lake

Python/Java

Git & CI/CD

Apache Spark/PySpark

Docker & Kubernetes

GCP Certifications

IT experience

Tools

BigQuery

Dataflow

Pub/Sub

Python

Java

Git

CI/CD

Kafka

Docker

Kubernetes

Dataproc

Cloud Storage

Job description

Interview Mode: Virtual Interview on 17th October

Job Summary

We are looking for an experienced GCP Data Engineer with strong expertise in designing, developing, and maintaining scalable data platforms on Google Cloud Platform (GCP). The ideal candidate should have hands‑on experience in data ingestion, transformation, ETL development, cloud‑native data services, and large‑scale data processing.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines on GCP.
• Build and maintain data processing solutions using BigQuery, Dataflow, Dataproc, and Cloud Storage.
• Develop and optimize data ingestion and transformation frameworks.
• Work with structured and unstructured data from multiple sources.
• Collaborate with Data Scientists, Analysts, and Business teams to support data requirements.
• Implement data quality, governance, security, and monitoring processes.
• Troubleshoot performance issues and optimize data workflows.
• Follow CI/CD and DevOps best practices for deployment and maintenance.

Required Skills

• 6-10 years of overall IT experience.
• Strong experience with Google Cloud Platform (GCP).
• Hands‑on experience with:
• BigQuery
• Dataflow
• Pub/Sub
• Experience in building ETL/ELT pipelines.
• Knowledge of Python or Java for data engineering.
• Understanding of data warehousing and data lake concepts.
• Experience with Git and CI/CD processes.

Preferred Skills

• Experience with Apache Spark/PySpark.
• GCP Certifications.
• Exposure to Kafka and real‑time data processing.
• Experience with Docker and Kubernetes.

Looking for candidates with a 90-day notice period.