GCP Data Engineer

Reflections Info Systems; Thiruvananthapuram; On-site; INR 1,200,000 - 2,400,000; Full time

Job summary

Reflections Info Systems in India is seeking a data engineer to design batch and real-time data pipelines, ingest data from databases, APIs, files, SaaS and streaming sources, and optimize BigQuery datasets and partitions.

You will build transformations using SQL, Python, Beam, Spark or dbt/Dataform; implement orchestration with Airflow/Composer; apply IAM security; optimize workloads; and contribute to Terraform-based infrastructure and CI/CD, collaborating with Data Architects, Analysts and

Qualifications

Responsibilities

• Design batch and real-time data pipelines.
• Develop scalable ETL/ELT pipelines using Dataflow, BigQuery and Composer.
• Ingest data from databases, APIs, files, SaaS applications and streaming sources.
• Design optimized BigQuery datasets, tables, partitioning and clustering.
• Build data transformations using SQL, Python, Beam, Spark or dbt/Dataform.
• Implement orchestration and dependency management using Airflow/Cloud Composer.
• Implement GCP security using IAM, service accounts and least-privilege access.
• Optimize BigQuery/Dataflow workloads for performance and cloud cost.
• Build infrastructure using Terraform and participate in CI/CD.
• Work with Data Architects, Analysts, Data Scientists and application teams.

Tools

Dataflow

BigQuery

Cloud Composer

Airflow

Terraform

dbt/Dataform

Python

SQL

Beam

Spark

Job description

Job Description

• Design batch and real-time data pipelines.
• Develop scalable ETL/ELT pipelines using Dataflow, BigQuery and Composer.
• Ingest data from databases, APIs, files, SaaS applications and streaming sources.
• Design optimized BigQuery datasets, tables, partitioning and clustering.
• Build data transformations using SQL, Python, Beam, Spark or dbt/Dataform.
• Implement orchestration and dependency management using Airflow/Cloud Composer.
• Implement GCP security using IAM, service accounts and least-privilege access.
• Optimize BigQuery/Dataflow workloads for performance and cloud cost.
• Build infrastructure using Terraform and participate in CI/CD.
• Work with Data Architects, Analysts, Data Scientists and application teams.

Role

Location :

Close Date :

04-09-2026