Senior GCP Data Engineer

Tata Consultancy Services; Bengaluru; On-site; INR 1,200,000 - 2,000,000; Full time

Job summary

Tata Consultancy Services in Bengaluru is seeking a Senior GCP Data Engineer with 6-10 years of experience to design and implement scalable data pipelines on Google Cloud.

You will work with BigQuery, Dataflow, Dataproc, Cloud Composer, and GCS, applying best practices in data lake architectures, IAM, security, and cost governance while collaborating with DevOps teams to deliver reliable data solutions.

Qualifications

• Expert-level knowledge of GCP services including BigQuery, Dataflow, Dataproc, Cloud Composer.
• Strong proficiency in Python (Pandas, PySpark) and SQL for data wrangling.
• Experience with ETL/ELT design and data lake/warehouse architectures.
• DevOps & CI/CD using GitHub Actions, Jenkins, or Cloud Build.
• IaC experience with Terraform or Deployment Manager.

Skills

GCP

BigQuery

Dataflow

Dataproc

Cloud Composer

GCS

Python

SQL

ETL/ELT design

Data lake/warehouse

DevOps & CI/CD

IaC (Terraform)

IaC (Deployment Manager)

IAM & security

Data quality & lineage

Kafka/Snowflake/Looker integration

Tools

Terraform

Deployment Manager

GitHub Actions

Jenkins

Cloud Build

Job description

• Greetings from Tata Consultancy Services (TCS)!!!
• Job Title : Senior GCP Data Engineer
• Experince : 6-10 Years
• Mode of Interview : Virtual
• Expert-level knowledge of Google Cloud Platform services including:
• BigQuery – advanced SQL, partitioning, optimization, and cost control
• Dataflow (Apache Beam) – large-scale batch and streaming data pipelines
• Dataproc – Spark and Hadoop-based distributed processing
• Cloud Composer (Airflow) – workflow orchestration, scheduling, and dependency management
• Cloud Storage (GCS) – data lake setup, lifecycle management, access control
• Strong proficiency in Python (Pandas, PySpark, Beam SDK) and SQL for data wrangling and transformation.
• Expertise in ETL/ELT design, data lake/data warehouse/lakehouse architecture.
• Experience with DevOps & CI/CD using tools such as GitHub Actions, Jenkins, or Cloud Build.
• Hands-on with Terraform or Deployment Manager for Infrastructure as Code (IaC).
• Solid understanding of GCP IAM, VPC, security policies, and encryption mechanisms.
• Familiarity with data quality, metadata, lineage, and cataloging tools (e.g., Data Catalog).
• Proficiency in cost governance, performance tuning, and resource monitoring (Cloud Monitoring/Logging).
• Knowledge of modern data frameworks and data integration between systems like Kafka, Snowflake, or Looker.