GCP Data Engineer – Real-Time & Data Lake Migration

TEKsystems; Phoenix (AZ); Hybrid; USD 52,000 - 55,000; Full time

Benefits offered by this job

Medical, dental & vision

401(k) Retirement Plan - Pre-tax and R

Life Insurance

Short and long-term disability

Health Spending Account (HSA)

Transportation benefits

Employee Assistance Program

Time Off/Leave (PTO, Vacation or Sick)

Job summary

TEKsystems in Phoenix, AZ is hiring a Jr-Mid Level GCP Data Engineer to support a large-scale migration from on-prem Hadoop to Google Cloud. The role focuses on building and maintaining data pipelines in Hadoop and GCP, with hands-on PySpark, Python, and real-time streaming.

You will design scalable architectures, perform deployments, and collaborate across teams while adhering to enterprise change-management and access-control processes.

Qualifications

• 3+ years in data engineering with Hadoop and GCP
• Proficient with Spark/PySpark, Python for data pipelines
• Experience migrating on-prem to GCP environments

Responsibilities

• Build and support Spark-based pipelines in Hadoop using PySpark and Python
• Develop real-time pipelines using Kafka
• Design data flows using Spark Streaming and Flink
• Migrate data/workloads from on-prem Hadoop to GCP
• Work with BigQuery, Cloud Composer, Data Proc, and Cloud Storage
• Translate requirements into architecture, design, and deployment deliverables
• Conduct integration testing and production deployments
• Collaborate with architects and stakeholders to enable the platform
• Follow enterprise change-management and access-management processes
• Support the evolving GCP data platform while maintaining Hadoop

Skills

Hadoop

PySpark

Python

Kafka

Flink

Spark Streaming

GCP Data Services

BigQuery

Cloud Storage

DataProc

Cloud Composer

GCP Migration

Tools

BigQuery

Cloud Storage

DataProc

Cloud Composer

Job description

TEKsystems in Phoenix, AZ is hiring a Jr-Mid Level GCP Data Engineer to support a large-scale migration from on-prem Hadoop to Google Cloud. The role focuses on building and maintaining data pipelines in Hadoop and GCP, with hands-on PySpark, Python, and real-time streaming.

You will design scalable architectures, perform deployments, and collaborate across teams while adhering to enterprise change-management and access-control processes.