Lead Data Engineer

Capgemini; United States; Remote; USD 58,000 - 91,000; Full time

Benefits offered by this job

Medical benefits

Dental benefits

Vision benefits

Retirement benefits

Job summary

Tundra Technical Solutions is seeking a lead Data Engineer with strong technical leadership to drive data pipeline architecture and delivery in a cloud-first environment. You will mentor teams, shape roadmaps, and ensure scalable data platforms across the enterprise.

The role emphasizes hands-on GCP expertise (BigQuery, Dataflow, Dataproc), CI/CD, and collaboration with data scientists and analysts to enable advanced analytics and ML use cases. Equal opportunity employer.

Qualifications

• Technical leadership experience is mandatory.
• Lead experience of 5+ years required; candidates without 5+ years as lead will not be considered.
• Proficiency in SQL, Python, Java/Scala and distributed systems (Spark, Beam).
• Hands-on GCP with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow) and Terraform.

Responsibilities

• Lead engineers, review code, establish data engineering standards, CI/CD and monitoring.
• Build and optimize ETL/ELT pipelines using Dataflow, Dataproc, Pub/Sub and Cloud Functions.
• Architect and manage BigQuery, Cloud Storage and Data Fusion for data ingestion and storage.
• Drive performance, cost optimization and collaboration with data architects, scientists and analysts.
• Shape backlog and user stories; team leads execution and delivery.

Skills

SQL

Python

Java/Scala

Distributed systems

Tools

BigQuery

Dataflow

Dataproc

Pub/Sub

Composer

Terraform

Cloud Run

Job description

Technical leadership experience is mandatory. We are looking for a lead, not a senior Data engineer. Candidates without 5+ years of experience as lead will not be considered.

Technical: Proficiency in SQL, Python, Java/Scala, and distributed systems (Spark, Beam).

GCP Expertise: Hands-on with BigQuery, Dataflow, Dataproc, Pub/Sub, Composer (Airflow), and Terraform.

Cloud SQL, Cloud Storage and GCP Suite, Cloud Run (Heavy) and custom templates

Kafka (based upon data source) Data Plex is use with Every workflow.

Leadership: Experience leading projects, mentoring teams, and driving technical roadmaps.

DevOps: Familiarity with CI/CD, Git, and infrastructure-as-code.

Leads help shape backlog and user stories (team then owns/executes).

Nice to Have:

GCP Certifications (e.g., Professional Data Engineer).

Experience with real-time processing, Vertex AI, or multi-cloud environments.

DBT Labs & understanding of clinical/CMS billing data (context for latter: resources will be working with full medallion layers in cloud.).

Key Responsibilities:

Team Leadership: Lead engineers, review code, establish data engineering standards, CI/CD, and monitoring (e.g., Cloud Monitoring, Logging). Leadership experience is mandatory.

Pipeline Development: Build and optimize ETL/ELT pipelines using Dataflow (Apache Beam), Dataproc (Spark), Pub/Sub, and Cloud Functions.

Data Infrastructure: Architect and manage BigQuery, Cloud Storage, and Data Fusion for efficient data ingestion, transformation, and storage.

Performance & Cost: Optimize pipeline performance, query efficiency, and GCP cost management (e.g., slot reservations, partitioning).

Collaboration: Work with data architects, scientists, and analysts to deliver self-service data platforms and support advanced analytics/ML use cases.

Data Quality & Governance: Implement data validation, lineage, and metadata management (e.g., Data Catalog, dbt).

The pay range that the employer in good faith reasonably expects to pay for this position is $42.07/hour - $65.73/hour. Applications will be accepted on an ongoing basis.

• Our benefits include medical, dental, vision and retirement benefits.

Tundra Technical Solutions is among North America’s leading providers of Staffing and Consulting Services. Our success and our clients’ success are built on a foundation of service excellence. We are an equal opportunity employer, and we do not discriminate on the basis of race, religion, color, national origin, sex, sexual orientation, age, veteran status, disability, genetic information, or other applicable legally protected characteristic. Qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law, including the Los Angeles County Fair Chance Ordinance for Employers and the California Fair Chance Act. Unincorporated LA County workers: we reasonably believe that criminal history may have a direct, adverse and negative relationship with the following job duties, potentially resulting in the withdrawal of a conditional offer of employment: client provided property, including hardware (both of which may include data) entrusted to you from theft, loss or damage; return all portable client computer hardware in your possession (including the data contained therein) upon completion of the assignment, and; maintain the confidentiality of client proprietary, confidential, or non-public information. In addition, job duties require access to secure and protected client information technology systems and related data security obligations.