Lead Data Engineer - GCP Data Platforms & Analytics

TSR Consulting; San Francisco (CA); On-site; USD 170,000 - 210,000; Full time

Benefits offered by this job

Major medical

HSA

Dental

Vision

Employer-provided group life

Voluntary life insurance

Short-term disability

Long-term disability

401K

Job summary

TSR Consulting is seeking a Lead Data Engineer on an onsite basis in Pleasanton, CA. You will design and build scalable data platforms and pipelines on Google Cloud Platform (GCP) to power analytics and AI for Supply Chain and Warehouse Management.

You will lead technical initiatives, mentor engineers, and collaborate with cross-functional teams to deliver robust data solutions. Strong experience with BigQuery, Dataproc, SQL, dbt, and Airflow is required, with preferred Python/PySpark skills.

Qualifications

• Design, develop, and maintain scalable data pipelines and data products on Google Cloud Platform (GCP).
• Strong experience with BigQuery, Dataproc, SQL, and dbt.
• Experience building scalable ETL/ELT pipelines.
• Experience working with Kafka and JSON data.
• Familiarity with Apache Airflow.
• Strong understanding of data modeling (Star Schema/Dimensional Modeling).
• Experience leading technical initiatives and mentoring engineers.
• Excellent communication and collaboration skills.

Responsibilities

• Lead design and development of scalable data platforms on GCP for analytics and AI in Supply Chain/WMS.
• Mentor engineers and drive technical initiatives across the team.
• Collaborate with stakeholders to ensure robust data pipelines and governance.

Skills

BigQuery

Dataproc

SQL

dbt

ETL/ELT

Kafka

JSON data

Apache Airflow

Data modeling (Star Schema)

Mentoring Engineers

Communication & collaboration

Python

PySpark

CI/CD

Git

Tools

Git

CI/CD

Job description

TSR Consulting is seeking a Lead Data Engineer on an onsite basis in Pleasanton, CA. You will design and build scalable data platforms and pipelines on Google Cloud Platform (GCP) to power analytics and AI for Supply Chain and Warehouse Management.

You will lead technical initiatives, mentor engineers, and collaborate with cross-functional teams to deliver robust data solutions. Strong experience with BigQuery, Dataproc, SQL, dbt, and Airflow is required, with preferred Python/PySpark skills.