GCP Bigquery

Infosys Limited; Bengaluru; On-site; INR 1,800,000 - 2,700,000; Full time

Job summary

Infosys Limited is seeking a GCP BigQuery data engineer in Bengaluru to design, develop, and optimize BigQuery datasets and ETL pipelines. You will work with GCS and Dataproc to handle ingestion and distributed processing, while ensuring data quality and governance across analytics initiatives.

You will collaborate with cross-functional teams, implement robust data models, and monitor pipelines for reliability and cost efficiency within the Google Cloud Platform.

Qualifications

• 3–5 years of experience in data engineering or analytics engineering roles with hands‑on BigQuery usage.
• Strong SQL skills with experience building transformations, aggregations, and analytical datasets in BigQuery.
• Experience working with ETL/ELT concepts, batch processing, and data pipeline troubleshooting.
• Working knowledge of GCS for data storage, ingestion patterns, and lifecycle handling.
• Exposure to Dataproc for Spark/Hadoop-based processing and job execution in GCP environments.

Responsibilities

• Design, develop, and maintain BigQuery datasets, tables, views, and SQL transformations aligned to analytics and reporting needs.
• Build and support ETL/ELT pipelines leveraging GCS for ingestion and Dataproc for distributed processing where required.
• Optimize BigQuery performance and cost through partitioning, clustering, query tuning, and efficient data modeling practices.
• Implement data quality checks, validation routines, and reconciliation processes to ensure trustworthy outputs.
• Collaborate with cross-functional teams to gather requirements, define data contracts, and deliver curated datasets.
• Monitor pipeline health, troubleshoot failures, perform root-cause analysis, and drive timely resolution.
• Maintain clear technical documentation for pipelines, datasets, transformations, and operational runbooks.
• Follow secure data handling practices and support access controls and governance standards within GCP.

Skills

SQL

Data modeling

ETL/ELT concepts

Batch processing

Data pipeline troubleshooting

Education

BTECH

MTECH

MCA

MSC

Tools

BigQuery

GCS

Dataproc

Spark/Hadoop

Looker

Terraform

Job description

Job Title

GCP Bigquery

Work Experience 3 - 5 Years

Educational Requirements

MCA,MSc,MTech,Bachelor of Engineering,BTech

Service Line

Data & Analytics Unit

Responsibilities

• Design, develop, and maintain BigQuery datasets, tables, views, and SQL transformations aligned to analytics and reporting needs.
• Build and support ETL/ELT pipelines leveraging GCS for ingestion and Dataproc for distributed processing where required.
• Optimize BigQuery performance and cost through partitioning, clustering, query tuning, and efficient data modeling practices.
• Implement data quality checks, validation routines, and reconciliation processes to ensure trustworthy outputs.
• Collaborate with cross-functional teams to gather requirements, define data contracts, and deliver curated datasets.
• Monitor pipeline health, troubleshoot failures, perform root-cause analysis, and drive timely resolution.
• Maintain clear technical documentation for pipelines, datasets, transformations, and operational runbooks.
• Follow secure data handling practices and support access controls and governance standards within GCP.

Minimum Qualifications

• Education: BTECH, MTECH, MCA, MSC.
• 3–5 years of experience in data engineering or analytics engineering roles with hands‑on BigQuery usage.
• Strong SQL skills with experience building transformations, aggregations, and analytical datasets in BigQuery.
• Experience working with ETL/ELT concepts, batch processing, and data pipeline troubleshooting.
• Working knowledge of GCS for data storage, ingestion patterns, and lifecycle handling.
• Exposure to Dataproc for Spark/Hadoop-based processing and job execution in GCP environments.

Additional Responsibilities

Preferred Qualifications:

• Experience designing dimensional or curated data models (e.g., star/snowflake) for analytics consumption in BigQuery.
• Familiarity with orchestration and scheduling approaches for ETL workflows and dependency management.
• Proven ability to improve pipeline reliability and performance through monitoring, alerting, and operational best practices.
• Experience with data governance practices including dataset organization, access management, and documentation standards.
• Strong stakeholder collaboration skills to translate business requirements into scalable, maintainable data solutions.

Technical and Professional Requirements

Good to have skills: Cloud Composer, Dataflow, Pub/Sub, Looker, Terraform

Preferred Skills

Technology->Cloud Platform->GCP Database->Google BigQuery