GCP Data Engineer

Tata Consultancy Services Limited; Zone 1 Tiruvottiyur; On-site; INR 2,500,000 - 3,800,000; Full time

Job summary

Tata Consultancy Services Limited is seeking an experienced GCP Data Engineer to design, develop, and maintain scalable data solutions on Google Cloud Platform. The role is based in India with multiple city options including Bangalore, Chennai, and Kolkata.

The ideal candidate will have 6+ years of IT experience in data engineering, strong Python, SQL, and hands-on GCP skills in BigQuery, Dataflow, Pub/Sub, and Airflow.

Responsibilities

• Design and develop scalable ETL/ELT data pipelines using GCP services.
• Build and maintain data warehouses and data lakes.
• Develop data ingestion frameworks for batch and real-time processing.
• Create optimized BigQuery data models and ensure data quality.
• Work closely with business stakeholders, data analysts, and data scientists.
• Implement monitoring, troubleshooting, and performance tuning for data pipelines.
• Ensure security, governance, and compliance standards are followed.

Skills

GCP

Python programming

SQL & data modeling

ETL/ELT development

CI/CD, Git & Agile

Real-time data processing

Tools

BigQuery

Dataflow

Pub/Sub

Cloud Composer (Airflow)

Cloud Storage

Cloud Functions

Job description

Job Title: GCP Data Engineer

Experience: 6+ Years

Location: Bangalore, Chennai, Kolkata

Job Description

We are looking for an experienced GCP Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data solutions on Google Cloud Platform.

Key Responsibilities

• Design and develop scalable ETL/ELT data pipelines using GCP services.
• Build and maintain data warehouses and data lakes.
• Develop data ingestion frameworks for batch and real-time processing.
• Create optimized BigQuery data models and ensure data quality.
• Work closely with business stakeholders, data analysts, and data scientists.
• Implement monitoring, troubleshooting, and performance tuning for data pipelines.
• Ensure security, governance, and compliance standards are followed.

Required Skills

• Strong experience in Google Cloud Platform (GCP).
• Hands-on experience with:
  • BigQuery
  • Dataflow
  • Pub/Sub
  • Cloud Composer (Airflow)
  • Cloud Storage
  • Cloud Functions
• Strong programming skills in Python.
• Expertise in SQL and data modeling.
• Experience in ETL/ELT development and optimization.
• Knowledge of CI/CD, Git, and Agile methodologies.
• Experience with real-time data processing is preferred.

Preferred Skills

• DBT knowledge.
• Terraform/Infrastructure as Code.
• Spark/PySpark experience.

Eligibility

• 5+ years of IT experience with relevant Data Engineering experience.
• Strong communication skills.