Digital : Google Data Engineering

Tata Consultancy Services; Bengaluru; On-site; INR 800,000 - 1,200,000; Full time

Job summary

Tata Consultancy Services is looking for a highly skilled Google Data Engineer (E4 level) in Chennai, India. You will design, build, and optimize scalable data solutions on Google Cloud Platform (GCP), with a focus on Big Data technologies and BigQuery.

The ideal candidate should have 5+ years of experience in Data Engineering, strong ETL/ELT pipeline skills, and proficiency in SQL. The role demands collaboration with data scientists and stakeholders for actionable insights, along with ensuring data quality and governance.

Qualifications

• 5+ years of experience in Data Engineering.
• 23 years of hands-on experience in GCP.
• Proven experience with BigQuery in production environments.

Responsibilities

• Design and maintain scalable data pipelines using GCP.
• Build and manage data warehouses with BigQuery.
• Integrate data from multiple sources and monitor production data pipelines.

Skills

Google BigQuery

Big Data technologies

ETL/ELT pipeline development

SQL (advanced level)

Data modeling

Hadoop / Spark / Hive

Python

CI/CD pipelines

Education

Bachelor's or Master's degree in Computer Science, Engineering, or related field

Tools

Google Cloud Platform

Apache Beam

Terraform

Job description

We are seeking a highly skilled Google Data Engineer (E4 level) to design, build, and optimize scalable data solutions on the Google Cloud Platform (GCP). The ideal candidate should have strong expertise in Big Data technologies and BigQuery, with hands‑on experience in data pipeline development, data modeling, and performance optimization.

Key Responsibilities

• Design, develop, and maintain scalable data pipelines using GCP services.
• Build and manage data warehouses using BigQuery.
• Develop and optimize ETL/ELT workflows for large‑scale datasets.
• Work with structured and unstructured data in Big Data environments.
• Ensure data quality, integrity, and governance across pipelines.
• Optimize queries and datasets for performance and cost efficiency in BigQuery.
• Integrate data from multiple sources (APIs, databases, streaming systems).
• Implement real‑time and batch data processing solutions.
• Collaborate with data scientists, analysts, and business stakeholders to deliver actionable insights.
• Monitor and troubleshoot production data pipelines.

Required Skills & Expertise

• Strong experience in Google BigQuery
  • Data modeling, partitioning & clustering
  • Query optimization and cost management
• Hands‑on with Big Data ecosystems
  • Hadoop / Spark / Hive (preferably Spark on GCP Dataproc)
• Expertise in ETL/ELT pipeline development
• Proficiency in SQL (advanced level)

GCP Ecosystem

• Hands‑on experience with:
  • Cloud Storage
  • Dataflow (Apache Beam)
  • Dataproc
  • Pub/Sub (streaming pipelines)
  • Cloud Composer (Airflow)
  • BigLake / Data Catalog (nice to have)

Programming

• Strong coding skills in:
  • Python (preferred)
  • Java/Scala (optional but good to have)

Data Engineering Concepts

• Data warehousing & dimensional modeling
• Schema design (star/snowflake)
• Data partitioning, clustering
• Batch and streaming architecture
• Data security & governance

Good to Have Skills

• Experience with CI/CD pipelines for data workflows
• Knowledge of Terraform / Infrastructure as Code
• Exposure to Looker / Data Studio / BI tools
• Experience in ML data pipelines on GCP
• Understanding of Data Mesh / Modern Data Architecture

Experience Requirements

• Typically 5+ years of experience in Data Engineering
• Minimum 23 years of hands‑on experience in GCP
• Proven experience working with BigQuery in production environments

Education

• Bachelor's or Master's degree in Computer Science, Engineering, or related field

Soft Skills

• Strong analytical and problem‑solving abilities
• Excellent communication and collaboration skills
• Ability to work in agile environments