GCP Senior Data Engineer

Capgemini; United States; Remote; USD 72,000 - 110,000; Full time

Job summary

Tundra Technical Solutions on behalf of Capgemini in the United States seeks a Lead Data Engineer to guide a team of 10 engineers onshore and offshore, shaping data pipelines and platform standards.

You'll own end-to-end data engineering, using GCP with BigQuery, Dataflow, Dataproc, Pub/Sub, Airflow, and Terraform, driving performance, cost optimization, and collaboration with architects, scientists, and analysts on advanced analytics and ML use cases.

Qualifications

• Leadership experience directing data engineering teams onshore/offshore.
• Hands-on with SQL, Python, Java/Scala; knowledge of distributed systems (Spark/Beam).
• GCP expertise with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer, Terraform.
• DevOps familiarity with CI/CD, Git and infra-as-code.

Responsibilities

• Pipeline Development: Build and optimize ETL/ELT pipelines using Dataflow, Dataproc, Pub/Sub, and Cloud Functions.
• Data Infrastructure: Architect and manage BigQuery, Cloud Storage, and Data Fusion for ingestion, transformation, and storage.
• Team Leadership: Lead a team of 10 engineers, review code, establish data eng standards, CI/CD, and monitoring.
• Performance & Cost: Optimize pipeline performance, query efficiency, and GC/GCP cost management.
• Collaboration: Work with data architects, scientists, and analysts on self-service data platforms for analytics/ML.

Skills

Python

Shell scripting

Makefiles

CI/CD

SQL

Java/Scala

Distributed systems

Spark

Beam

BigQuery

Dataflow

Dataproc

Pub/Sub

Composer

Terraform

Git

Data governance

Tools

Terraform

dbt

Job description

Python (3.x), Shell scripting, Makefiles, CI/CD for verification

Leadership: Experience leading data engineering teams onshore and offshore. This is a lead position, not a senior data engineer position. Candidates without leadership experience will not be considered for this role.

Technical: Proficiency in SQL, Python, Java/Scala, and distributed systems (Spark, Beam).

GCP Expertise: Hands-on with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow), and Terraform.

DevOps: Familiarity with CI/CD, Git, and infrastructure-as-code.

Nice to Have

• GCP Certifications (e.g., Professional Data Engineer).
• Experience with real-time processing, Vertex AI, or multi-cloud environments.

Key Responsibilities

Pipeline Development: Build and optimize ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub, and Cloud Functions.

Data Infrastructure: Architect and manage BigQuery, Cloud Storage, and Data Fusion for efficient data ingestion, transformation, and storage.

Team Leadership: Lead a team of 10 engineers, review code, establish data engineering standards, CI/CD, and monitoring (e.g., Cloud Monitoring, Logging).

Performance & Cost: Optimize pipeline performance, query efficiency, and GCP cost management (e.g., slot reservations, partitioning).

Collaboration: Work with data architects, scientists, and analysts to deliver self-service data platforms and support advanced analytics/ML use cases.

Data Quality & Governance: Implement data validation, lineage, and metadata management (e.g., Data Catalog, dbt).

The pay range that the employer in good faith reasonably expects to pay for this position is $51.62/hour - $80.66/hour. Our offered benefits include medical, dental, vision and retirement benefits. Applications will be accepted on an ongoing basis.

Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.