Gcp Data Engineer

TeamLease; Bengaluru, Hyderabad; On-site; INR 900,000 - 1,400,000; Full time

Job summary

TeamLease in Bengaluru is seeking a Data Engineer to design, develop, and maintain large-scale data pipelines on Google Cloud Platform using Airflow, BigQuery, Dataproc and Dataflow.

You will collaborate with cross-functional teams to translate business requirements into scalable data solutions, write complex SQL queries to derive insights, implement automated testing, and troubleshoot pipeline performance bottlenecks to ensure reliable data delivery.

Qualifications

• Experience with data pipelines and scalable data processing
• Strong SQL for data extraction and analytics
• Familiarity with Google Cloud Platform services such as Airflow, BigQuery, Dataproc, Dataflow

Responsibilities

• Design, develop, and maintain large-scale data pipelines on GCP.
• Collaborate with cross-functional teams to translate business requirements into data solutions.
• Develop complex SQL queries to derive insights from BigQuery datasets.
• Implement automated testing frameworks to ensure code quality.
• Troubleshoot pipeline failures and performance bottlenecks to ensure reliability.

Skills

SQL

Tools

Airflow

BigQuery

Dataproc

Dataflow

Job description

Roles and Responsibilities

• Design, develop, and maintain large-scale data pipelines using Airflow, BigQuery, Dataproc, and Data Flow on Google Cloud Platform (GCP).


• Collaborate with cross-functional teams to identify business requirements and design solutions that meet those needs.


• Develop complex SQL queries to extract insights from massive datasets stored in BigQuery.


• Implement automated testing frameworks to ensure high-quality code delivery.


• Troubleshoot issues related to pipeline failures or performance bottlenecks.