Gcp Data Engineer

Tata Consultancy Services; India; On-site; INR 1,500,000 - 2,500,000; Full time

Job summary

Tata Consultancy Services is seeking an experienced data engineer with 5-10 years of data engineering work and hands-on GCP exposure. The role focuses on building scalable data pipelines using BigQuery, Dataproc, Dataflow, and Airflow, with strong Python, SQL and Spark skills.

You will design and optimize data warehouse and data lake architectures, ensuring performance, security, and governance across cloud data assets. Some exposure to Hadoop or Teradata is a plus.

Qualifications

• 5-10 years of data-engineering experience with 2+ years of hands-on GCP experience.
• Hands-on experience with BigQuery, Dataproc and Dataflow.
• Experience with Pub/Sub, Cloud Functions, Data Fusion and Data Transfer.
• Strong PySpark or Spark, Python and SQL skills; Java/Scala is an advantage.
• Experience with Cloud Composer and Airflow orchestration.

Responsibilities

• Develop and maintain data pipelines on GCP architectures.
• Optimize data warehouse and data lake designs for performance.
• Ensure data security and access governance using IAM.

Skills

GCP

BigQuery

Dataproc

Dataflow

Pub/Sub

Cloud Functions

Data Fusion

Data Transfer

PySpark

Python

SQL

Java/Scala

Airflow

Data warehouse

Data lake

Pipelines

IAM

Hadoop

Teradata

Tools

Airflow

Dataproc

BigQuery

Teradata

Job description

Role & responsibilities

• 5-10 years of role-dependent data-engineering experience, including 2+ years of hands‑on GCP experience.
• Hands‑on experience with BigQuery, Dataproc and Dataflow.
• Experience with Pub/Sub, Cloud Functions, Data Fusion and Data Transfer.
• Strong PySpark or Spark, Python and SQL skills; Java or Scala is an advantage.
• Experience with Cloud Composer and Airflow orchestration.
• Strong understanding of data-warehouse, data-lake and pipeline architecture, design and performance tuning.
• Knowledge of Cloud IAM for data security and access governance.
• Good‑to‑have exposure to Hadoop, Teradata or on-pr