Senior Data Engineer: Real-Time Pipelines & GCP Migration

TEKsystems; United States; Hybrid; USD 69,000 - 74,000; Full time

Benefits offered by this job

Medical, dental & vision

401(k) Retirement Plan

Life Insurance

Disability

Health Spending Account

Transit benefits

Employee Assistance Program

PTO / Vacation / Sick leave

Job summary

TEKsystems in Charlotte, NC seeks a midlevel Data Engineer for a contract role in a hybrid setup. You will migrate on‑prem Hadoop workloads to Google Cloud Platform, building Spark/PySpark pipelines and real‑time streaming with Kafka.

You will design, deploy, and optimize data pipelines across Hadoop and GCP, collaborating with cross‑functional teams and following enterprise change‑management procedures to ensure secure, scalable data movement.

Qualifications

• Hands-on experience with Hadoop and PySpark in enterprise environments.
• Strong Python development skills for data pipelines.
• Experience implementing real-time streaming with Kafka.
• Design and deploy data pipelines across on-prem and cloud.
• Familiarity with data lake/storage on GCP (BigQuery, Data Proc).

Responsibilities

• Build Spark-based processing pipelines in Hadoop with PySpark.
• Develop real-time streaming pipelines using Kafka.
• Migrate data/workloads from on-prem to GCP.
• Work with BigQuery, Data Proc, and Cloud Storage in GCP.
• Partner with architects and stakeholders to deliver scalable solutions.

Skills

Hadoop

PySpark

Python

Kafka

Spark Streaming

Flink

Tools

BigQuery

Cloud Composer

Data Proc

Cloud Storage

Job description

TEKsystems in Charlotte, NC seeks a midlevel Data Engineer for a contract role in a hybrid setup. You will migrate on‑prem Hadoop workloads to Google Cloud Platform, building Spark/PySpark pipelines and real‑time streaming with Kafka.

You will design, deploy, and optimize data pipelines across Hadoop and GCP, collaborating with cross‑functional teams and following enterprise change‑management procedures to ensure secure, scalable data movement.