Senior GCP Data Engineer: Real-Time Pipelines & BigQuery

KTek Resourcing LLC; United States; On-site; USD 120,000 - 180,000; Full time

Job summary

KTek Resourcing LLC seeks an experienced GCP Data Engineer to design, develop, and maintain scalable data solutions on Google Cloud Platform. You will work with BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and Python to build modern data pipelines for large-scale datasets.

The role focuses on ETL/ELT development, data modeling, and data warehousing with emphasis on performance, cost optimization, and reliability across batch and streaming workloads.

Qualifications

• Bachelor's degree in computer science, engineering, information technology, or related field.
• 5+ years of experience in data engineering with strong hands-on GCP experience.
• Strong understanding of distributed data processing and cloud-native data architecture.
• Excellent problem-solving, communication, and collaboration skills.

Responsibilities

• Design and develop end-to-end data pipelines using GCP data services.
• Build scalable ingestion and transformation pipelines using Cloud Dataflow / Apache Beam.
• Develop complex SQL queries, stored procedures, and data transformations in BigQuery.
• Design and optimize BigQuery data warehouses, including partitioning, clustering, performance tuning, and cost optimization.
• Implement batch and real-time data processing using Dataflow, Pub/Sub, and BigQuery.
• Develop data ingestion solutions using Google Cloud Storage (GCS) and other cloud data sources.
• Build and manage workflow orchestration using Cloud Composer / Apache Airflow.
• Develop Python-based ETL/ELT frameworks and reusable data engineering components.
• Integrate data from APIs, databases, files, streaming platforms, and enterprise applications.
• Implement data quality, validation, monitoring, logging, and error-handling frameworks.

Skills

Python

SQL

ETL/ELT

Batch processing

Streaming

Data modeling

Data warehousing

Apache Beam

Airflow

Spark

Education

Bachelor's degree

Tools

BigQuery

Cloud Spanner

PostgreSQL/MySQL

Google Cloud Storage

Cloud Composer

Dataflow

Apache Airflow

Cloud IAM

GCS Computer Networking

Job description

KTek Resourcing LLC seeks an experienced GCP Data Engineer to design, develop, and maintain scalable data solutions on Google Cloud Platform. You will work with BigQuery, Cloud Storage, Dataflow, Pub/Sub, Cloud Composer, and Python to build modern data pipelines for large-scale datasets.

The role focuses on ETL/ELT development, data modeling, and data warehousing with emphasis on performance, cost optimization, and reliability across batch and streaming workloads.