Remote GCP Data Engineer - Medallion Architect & BigQuery

KANINI; United States; Remote; USD 140,000 - 200,000; Full time

Job summary

KANINI is seeking a Senior Data Engineer with deep GCP expertise to design scalable data pipelines and implement Medallion Architecture for enterprise-grade data solutions.

The role requires hands-on work with BigQuery, PySpark, Dataflow, Airflow, GCS, and CI/CD practices, plus strong SQL and data modeling skills. Remote position for the United States with governance and security emphasis.

Qualifications

• Experience with Google Cloud Platform (GCP) in enterprise data environments.
• Strong SQL skills including advanced joins, window functions, and optimization.
• Hands-on experience building scalable batch and real-time data pipelines.

Responsibilities

• Design, develop, and maintain scalable batch and real-time data pipelines on GCP.
• Implement Medallion Architecture (Bronze, Silver, Gold) for data processing.
• Build high-performance data transformations using Python and PySpark.
• Develop and optimize complex SQL queries for analytical workloads.
• Work with BigQuery for large-scale data processing and performance tuning.
• Develop and deploy pipelines using Cloud Dataflow.
• Orchestrate workflows with Cloud Composer (Airflow).
• Manage data storage and lifecycle using Google Cloud Storage (GCS).
• Implement version control and CI/CD pipelines using Git-based tools.
• Ensure data security, governance, and access control using GCP IAM.
• Optimize data solutions for performance, scalability, reliability, and cost-efficiency.

Skills

GCP

BigQuery

Medallion Architecture

Python

PySpark

Java

SQL

Dataflow

Airflow

GCS

CI/CD

IAM

Tools

Git

Cloud Composer

Job description

KANINI is seeking a Senior Data Engineer with deep GCP expertise to design scalable data pipelines and implement Medallion Architecture for enterprise-grade data solutions.

The role requires hands-on work with BigQuery, PySpark, Dataflow, Airflow, GCS, and CI/CD practices, plus strong SQL and data modeling skills. Remote position for the United States with governance and security emphasis.