GCP BigQuery Developer

Infosys; Maharashtra; On-site; INR 1,400,000 - 2,500,000; Full time

Job summary

Infosys is seeking a data engineering professional to design, develop, and optimize BigQuery-based data warehouses and data marts in a GCP environment. You will build and maintain ETL/ELT pipelines, write advanced SQL for transformations, and orchestrate workflows using Cloud Composer (Airflow) and Dataflow/Dataproc.

The role requires hands-on experience with data modeling, query optimization, and implementing security and governance within GCP.

Qualifications

• Strong experience with Google BigQuery.
• Advanced proficiency in SQL and Python or PySpark.
• Hands-on experience with GCP services: BigQuery, Cloud Storage, Dataflow/Dataproc, Cloud Composer (Airflow).
• Experience in ETL/ELT pipeline development and data warehousing concepts.
• Familiarity with data partitioning and clustering in BigQuery.

Responsibilities

• Design, develop, and optimize BigQuery-based data warehouses and data marts.
• Build and maintain ETL/ELT pipelines using GCP services.
• Write efficient, complex SQL queries for data transformation and analysis.
• Work with Cloud Composer (Airflow), Dataflow, or Dataproc for orchestration.
• Perform data modeling (star/snowflake) for analytics use cases.
• Ensure security and governance best practices within GCP.

Skills

BigQuery

SQL

ETL/ELT

Data modelling

Performance tuning

Data governance

Education

Bachelor's degree in CS/IT or related field

Tools

Google Cloud Platform (GCP)

BigQuery

Cloud Storage

Dataflow/Dataproc

Cloud Composer (Airflow)

Python

PySpark

Terraform

Looker/Tableau/Power BI

Pub/Sub

Job description

Strong experience with Google BigQuery Advanced proficiency in SQL Hands-on experience with GCP services: BigQuery Cloud Storage Dataflow / Dataproc Cloud Composer (Airflow) Experience in ETL/ELT pipeline development Good understanding of data warehousing concepts Familiarity with Python or PySpark for data processing Experience in performance tuning and query optimization Knowledge of data partitioning and clustering in BigQuery

Design, develop, and optimize BigQuery-based data warehouses and data marts Build and maintain ETL/ELT pipelines using GCP services Write efficient, complex SQL queries for data transformation and analysis Work with Cloud Composer (Airflow), Dataflow, or Dataproc for pipeline orchestration Perform data modelling (star/snowflake schema) for analytics use cases Optimize query performance and manage BigQuery cost efficiency Integrate data from various sources (APIs, Cloud Storage, databases, streaming sources) Implement data validation, quality checks, and monitoring mechanisms Collaborate with data analysts, data scientists, and business stakeholders Ensure security and governance best practices within GCP

Experience with CI/CD tools (Cloud Build, Jenkins, GitHub Actions) Knowledge of data visualization tools (Looker, Tableau, Power BI) Familiarity with streaming data pipelines (Pub/Sub) Experience with Infrastructure as Code (Terraform) Understanding of data governance and access control in GCP Bachelor's degree in Computer Science, IT, or related field GCP certifications (e.g., Professional Data Engineer) are a plus