GCP BigQuery Data Engineer

Elabs Infotech; Hyderabad, Pune District, Bengaluru; On-site; INR 2,500,000 - 4,200,000; Full time

Job summary

Elabs Infotech in Hyderabad is seeking an experienced GCP BigQuery Data Engineer to design scalable data solutions on Google Cloud Platform. The role requires strong SQL and Python skills, and experience with large cloud-based datasets.

You will optimize query performance, build data pipelines, and collaborate with cross-functional teams. Exposure to Airflow/Composer and Gemini Enterprise is a plus for advancing our AI-powered data initiatives.

Qualifications

• Strong hands-on experience with GCP BigQuery.
• Excellent knowledge of Advanced SQL, including complex queries, joins, window functions, and query optimization.
• Strong programming skills in Python.
• Experience working with large datasets and cloud-based data processing.

Responsibilities

• Design, develop, and maintain scalable data solutions using GCP BigQuery.
• Write, optimize, and troubleshoot complex SQL queries for large datasets.
• Develop Python scripts for data processing, automation, and integration.
• Optimize BigQuery performance and cost through efficient query design and resource utilization.
• Build and maintain data pipelines and workflows.
• Work with Apache Airflow and Google Cloud Composer for workflow orchestration.
• Explore and integrate Google ADK and Gemini Enterprise capabilities where applicable.
• Collaborate with cross-functional teams to deliver reliable and high-performance data solutions.

Skills

GCP BigQuery

Advanced SQL

Python

Data processing

Query optimization

Tools

Apache Airflow

Google Cloud Composer

Google ADK

Gemini Enterprise

Job description

Job Description

We are looking for an experienced GCP BigQuery Data Engineer with strong hands-on expertise in Google Cloud Platform, BigQuery, Advanced SQL, and Python. The ideal candidate should be skilled in data processing, query optimization, and developing scalable data solutions. Exposure to workflow orchestration tools and Google's AI development technologies will be an added advantage.

Key Responsibilities

• Design, develop, and maintain scalable data solutions using GCP BigQuery.
• Write, optimize, and troubleshoot complex SQL queries for large datasets.
• Develop Python scripts for data processing, automation, and integration.
• Optimize BigQuery performance and cost through efficient query design and resource utilization.
• Build and maintain data pipelines and workflows.
• Work with Apache Airflow and Google Cloud Composer for workflow orchestration.
• Explore and integrate Google ADK (Agent Development Kit) and Gemini Enterprise capabilities where applicable.
• Collaborate with cross-functional teams to deliver reliable and high-performance data solutions.

Required Skills

• Strong hands-on experience with GCP BigQuery.
• Excellent knowledge of Advanced SQL, including complex queries, joins, window functions, and query optimization.
• Strong programming skills in Python.
• Experience working with large datasets and cloud-based data processing.

Good to Have

• Experience with Apache Airflow and Google Cloud Composer.
• Familiarity with Google ADK (Agent Development Kit).
• Exposure to Gemini Enterprise and AI-powered solutions.
• Understanding of data pipeline development and orchestration.

Preferred Candidate Profile

• Strong analytical and problem-solving skills.
• Ability to work independently and collaboratively in a team environment.
• Good communication and stakeholder management skills.