GCP Engineer - BigQuery

Infosys; Ahmedabad District; On-site; INR 900,000 - 1,500,000; Full time

Job summary

Infosys is seeking a data engineer focused on BigQuery development to design and maintain scalable data warehouse solutions. You will build data pipelines, optimize SQL queries, and collaborate with analysts and BI teams to translate business needs into robust data models.

The role requires hands-on experience with BigQuery, data modelling (star/snowflake), and a strong Python/SQL scripting skill set within a GCP environment. A strong emphasis on performance and cost efficiency is expected.

Qualifications

• 3-5 years of experience in data engineering / BigQuery development.
• Strong expertise in SQL (mandatory).
• Hands-on experience with Google BigQuery.
• Experience with data modelling (star/snowflake schemas).
• GCP Tools and Services: BigQuery, Cloud Storage, Dataflow / Dataproc, Pub/Sub, Cloud Composer (Airflow).
• Proficiency in Python / SQL scripting.
• Experience with Spark (PySpark) is a plus.

Responsibilities

• Design and implement data warehouse solutions using Google BigQuery.
• Develop, optimise, and maintain complex SQL queries and data models.
• Create efficient partitioning, clustering, and indexing strategies.
• Build scalable data pipelines using GCP services (Dataflow, Dataproc, Cloud Composer).
• Perform data ingestion from various sources (APIs, databases, cloud storage).
• Ensure data transformation, cleansing, and validation.
• Optimise BigQuery queries for cost and performance.
• Monitor query execution and tune workloads.
• Implement ETL/ELT workflows using BigQuery, Cloud Storage, and Pub/Sub.
• Integrate data from multiple cloud and on-prem systems.
• Automate workflows and scheduling.
• Work closely with data analysts, data scientists, and business teams.
• Support reporting tools like Looker, Data Studio (Looker Studio), and Tableau.
• Translate business requirements into scalable data solutions.

Skills

SQL

BigQuery

Python / SQL scripting

Spark (PySpark)

Tools

Dataflow

Dataproc

Cloud Composer (Airflow)

Pub/Sub

Looker Studio

Data Studio

Tableau

Job description

The core responsibilities for the job include the following:

Data Warehousing and BigQuery Development:

• Design and implement data warehouse solutions using Google BigQuery.
• Develop, optimise, and maintain complex SQL queries and data models.
• Create efficient partitioning, clustering, and indexing strategies.

Data Pipeline Development:

• Build scalable data pipelines using GCP services (Dataflow, Dataproc, Cloud Composer).
• Perform data ingestion from various sources (APIs, databases, cloud storage).
• Ensure data transformation, cleansing, and validation.

Performance Optimisation:

• Optimise BigQuery queries for cost and performance.
• Monitor query execution and tune workloads.
• Implement best practices for storage and compute efficiency.

Integration and ETL/ELT:

• Implement ETL/ELT workflows using BigQuery, Cloud Storage, and Pub/Sub.
• Integrate data from multiple cloud and on-prem systems.
• Automate workflows and scheduling.

Collaboration and Reporting:

• Work closely with data analysts, data scientists, and business teams.
• Support reporting tools like Looker, Data Studio (Looker Studio), and Tableau.
• Translate business requirements into scalable data solutions.

Requirements:

• 3-5 years of experience in data engineering / BigQuery development.
• Strong expertise in SQL (mandatory).
• Hands-on experience with Google BigQuery.
• Experience with data modelling (star/snowflake schemas).
• GCP Tools and Services: BigQuery, Cloud Storage, Dataflow / Dataproc, Pub/Sub, Cloud Composer (Airflow).

Programming Skill:

• Proficiency in Python / SQL scripting.
• Experience with Spark (PySpark) is a plus.