Senior GCP Data Engineer & AI Pipelines Lead

Capgemini Engineering; Dallas (TX); Hybrid; USD 86.000 - 144.000; Vollzeit

Benefits dieser Stelle

Paid time off

Medical, dental, vision coverage

401(k) retirement plan

Life and disability insurance

Employee assistance program

Zusammenfassung

Capgemini is seeking a Lead GCP Engineer to design, build and operate scalable data pipelines on GCP from Dallas, TX. You will drive batch and streaming solutions, mentor teams and collaborate with architects and stakeholders across functions.

The role demands hands-on expertise in Python, SQL, Spark, GCP data services, and modern orchestration tools. Hybrid onsite presence in Dallas/Charlotte is expected.

Qualifikationen

• 10+ years IT experience with 5+ years in data engineering and 2+ years in GCP.
• Hands-on experience with Python, SQL, Spark, PySpark, and UNIX/Linux.
• Expert in GCP data services: BigQuery, Composer, Airflow, GCS, Dataproc, Dataflow.
• Experience building batch and real-time data pipelines using Kafka.
• Knowledge of Data Warehousing, Data Lakes and Big Data platforms.
• Experience with Oracle Exadata and on-prem big data ecosystems.
• Strong workflow orchestration experience with Airflow, Composer and Autosys.
• Solid GitHub, GitHub Actions, Harness, and CI/CD practices.
• Experience deploying workloads on OpenShift (OCP).
• Understanding of EDA, streaming platforms, data governance and data quality.
• Ability to lead design discussions, perform code reviews and mentor teams.
• Experience leveraging AI build tools and Agentic AI-based solutions.

Aufgaben

• Design, develop and support scalable data pipelines and platforms on GCP.
• Lead the implementation of batch and streaming data solutions.
• Drive cloud modernization and migration initiatives.
• Optimize data processing performance, reliability and cost.
• Collaborate with architects, business stakeholders and cross-functional teams.
• Provide technical leadership to onshore and offshore engineering teams.

Kenntnisse

GCP

Data Engineering

Python

SQL

Spark/PySpark

UNIX/Linux

Kafka

OpenShift

GitHub/GitHub Actions

CI/CD

Airflow

Autosys

Event-Driven Architecture

AI build tools

Tools

BigQuery

Composer

Airflow

GCS

Dataproc

Dataflow

Kafka

OpenShift

GitHub

GitHub Actions

Harness

Jobbeschreibung

Capgemini is seeking a Lead GCP Engineer to design, build and operate scalable data pipelines on GCP from Dallas, TX. You will drive batch and streaming solutions, mentor teams and collaborate with architects and stakeholders across functions.

The role demands hands-on expertise in Python, SQL, Spark, GCP data services, and modern orchestration tools. Hybrid onsite presence in Dallas/Charlotte is expected.