GCP Engineer

Tech Mahindra; Chennai District; On-site; INR 1,800,000 - 2,800,000; Full time

Job summary

Tech Mahindra is seeking a GCP Data Engineer with hands-on experience in BigQuery, Dataproc, Google Cloud Storage (GCS), Apache Airflow, and Python to build scalable data pipelines and cloud-based analytics solutions.

You will design, develop, and maintain ETL/ELT pipelines on GCP, optimize SQL queries, and collaborate with analytics and engineering teams to ensure data quality and governance across data lakes and warehouses.

Qualifications

• Experience designing and building ETL/ELT pipelines on Google Cloud Platform.
• Strong hands-on expertise with BigQuery, Dataproc and GCS.
• Proficient in Apache Airflow or Cloud Composer and Python.
• Advanced SQL skills and experience with Spark for distributed processing.

Responsibilities

• Design, develop, and maintain ETL/ELT pipelines on GCP.
• Build scalable data processing solutions using BigQuery and Dataproc.
• Develop workflow orchestration using Airflow/Cloud Composer.
• Create data ingestion and transformation frameworks using Python.
• Manage data lakes and warehouses using GCS and BigQuery.
• Optimize SQL queries and improve pipeline performance.
• Implement monitoring, troubleshooting, and performance tuning.
• Collaborate with business, analytics, and engineering teams.
• Follow best practices for security, governance, and data quality.

Skills

BigQuery

GCS

Dataproc

Airflow/Cloud Composer

Python

Advanced SQL

Spark

ETL/ELT

Data Warehousing

Data Modeling

Git CI/CD

Agile

Education

Bachelor's degree or higher

Job description

A Bachelor’s or Higher Degree is the minimum entry required for the position

Image

Job Description

Looking for a GCP Data Engineer with hands on experience in BigQuery, Dataproc, Google Cloud Storage (GCS), Apache Airflow, and Python to build scalable data pipelines and cloud based analytics solutions.

Key Responsibilities

• Design, develop, and maintain ETL/ELT pipelines on GCP.
• Build scalable data processing solutions using BigQuery and Dataproc.
• Develop workflow orchestration using Airflow/Cloud Composer.
• Create data ingestion and transformation frameworks using Python.
• Manage data lakes and warehouses using GCS and BigQuery.
• Optimize SQL queries and improve pipeline performance.
• Implement monitoring, troubleshooting, and performance tuning.
• Collaborate with business, analytics, and engineering teams.
• Follow best practices for security, governance, and data quality.

Required Skills

• 4+ years of Data Engineering experience.
• Strong expertise in:
  • Google BigQuery
  • Google Cloud Storage (GCS)
  • Google Dataproc
  • Apache Airflow / Cloud Composer
  • Python
• Advanced SQL programming and query optimization.
• Experience with Spark and distributed data processing.
• Strong understanding of ETL/ELT, data warehousing, and data modeling.
• Experience with Git, CI/CD, and Agile methodologies.
• Excellent analytical and problem solving skills.

Preferred Skills

• Experience with Pub/Sub, Dataflow, DBT, or Looker.
• Knowledge of Terraform and Infrastructure as Code.
• Exposure to data governance and data quality frameworks.