Gcp Data Engineer

Consign Space Solutions Llp; Chennai District; On-site; INR 2,600,000 - 4,200,000; Full time

Job summary

Consign Space Solutions LLP is seeking a seasoned Data Engineer to design and manage cloud-based data pipelines using GCP services such as BigQuery, Dataflow, Pub/Sub, Cloud Composer, and Dataplex. Experience with Apache Beam for batch and streaming workloads is essential, along with CI/CD practices and Infrastructure as Code using GitHub Actions.

The role requires 6-8 years of experience in data engineering, with strong SQL and Python skills to build robust data solutions at scale.

Qualifications

• Need 6-8 years of experience in data engineering
• Proficiency in GCP services and data pipelines
• Strong SQL and Python programming skills

Responsibilities

• Proficiency in GCP services BigQuery, Dataflow, Pub/Sub, Cloud Composer, Dataplex, Airflow Composer
• Experience with Apache Beam for batch and streaming pipelines
• Experience in CI/CD and Infrastructure as Code (GitHub Actions)

Skills

SQL

Python

Apache Beam

GCP services

BigQuery

Dataflow

Pub/Sub

Airflow Composer

Tools

Google Cloud Platform

BigQuery

Dataflow

Pub/Sub

Cloud Composer

Dataplex

Airflow Composer

Apache Beam

GitHub Actions

CI/CD

Infrastructure as Code

Job description

Role & responsibilities

Experience Required: 6-8 years
Skills: Digital: Google Data Engineering

Role Descriptions: Proficiency in GCP services BigQuery| Dataflow| PubSub| Cloud Composer| Dataplex| Airflow Composer. Experience with Apache Beam for batch and streaming pipelines Exp in CICD and Infrastructure as Code (GitHub Actions) Strong SQL and Python programming skills
Essential Skills: Proficiency in GCP services BigQuery| Dataflow| PubSub| Cloud Composer| Dataplex| Airflow Composer. Experience with Apache Beam for batch and streaming

Preferred candidate profile