Senior Data Engineering

GiGa-Ops Global Solutions; Bengaluru; On-site; INR 1,800,000 - 3,200,000; Full time

Job summary

GiGa-Ops Global Solutions in Bengaluru is seeking a senior DAR | Data Engineer specializing in GCP. You will design scalable data pipelines, real-time and batch ingestion, and lakehouse architectures using Iceberg or Delta Lake, with BigQuery and GCS at the core.

You will work in a cloud-native environment, leveraging Python, Airflow, and CI/CD practices to deliver enterprise-grade data solutions. 5+ years of experience, strong Python, and hands-on GCP expertise are required.

Qualifications

• 5+ years of Data Engineering experience.
• 5+ years of Python development.
• 3+ years of batch and streaming processing (Airflow, Pub/Sub, Dataflow).
• 3+ years with Autosys, Airflow, and GCP environments.
• 3+ years with BigQuery and GCP ingestion stack.
• 3+ years with CI/CD tools and IAM.
• Strong ETL/ELT design and optimization experience.
• Hands-on expertise with Apache Iceberg or Delta Lake for scalable lakehouse implementations.

Skills

Python development

Data engineering

ETL/ELT design

Data modeling

DevOps practices

GCP concepts

Tools

Airflow

Autosys

Apache Iceberg

Delta Lake

BigQuery

GCS

Docker

Kubernetes

Job description

About the role:

DAR | Data Engineer | GCP Data Engineer

GCP Data Engineer with deep experience building scalable data pipelines, real‑time and batch ingestion frameworks, and cloud‑native data platforms. Strong expertise in Python-based data engineering, workflow orchestration, and enterprise-grade data solutions leveraging GCP services including BigQuery and modern ingestion stacks, with strong emphasis on lakehouse architectures using Apache Iceberg or Delta Lake table formats.

• 5+ years of Data Engineering experience
• 5+ years of Python development
• 3+ years of batch and streaming processing (Airflow, Pub/Sub, Dataflow)
• 3+ years with Autosys, Airflow, and GCP environments
• 3+ years with BigQuery and GCP ingestion stack
• 3+ years with CI/CD tools and IAM
• Strong ETL/ELT design and optimization experience
• Hands‑on expertise with Apache Iceberg or Delta Lake for scalable lakehouse implementations

Desired Qualifications:

• Strong expertise in streaming architectures
• Advanced experience with Iceberg or Delta Lake (schema evolution, time travel, ACID)
• Deep knowledge of data modeling and lakehouse design
• Python ecosystem (Pandas, NumPy, PySpark)
• Airflow + Autosys orchestration expertise
• GCP lakehouse (BigQuery + GCS + Iceberg/Delta)
• Data governance, lineage, and quality frameworks
• DevOps (CI/CD, Terraform, Docker, Kubernetes/OpenShift)
• BigQuery performance and cost optimization
• API-based ingestion

Good to have:

• Data observability tools (OpenLineage, Datadog, Cloud Monitoring, Prometheus) and SQL Sever SSIS familiarity.