Lead Data Engineer

TSR Consulting; San Francisco (CA); On-site; USD 170,000 - 210,000; Full time

Benefits offered by this job

Major medical

HSA

Dental

Vision

Employer-provided group life

Voluntary life insurance

Short-term disability

Long-term disability

401K

Job summary

TSR Consulting is seeking a Lead Data Engineer on an onsite basis in Pleasanton, CA. You will design and build scalable data platforms and pipelines on Google Cloud Platform (GCP) to power analytics and AI for Supply Chain and Warehouse Management.

You will lead technical initiatives, mentor engineers, and collaborate with cross-functional teams to deliver robust data solutions. Strong experience with BigQuery, Dataproc, SQL, dbt, and Airflow is required, with preferred Python/PySpark skills.

Qualifications

• Design, develop, and maintain scalable data pipelines and data products on Google Cloud Platform (GCP).
• Strong experience with BigQuery, Dataproc, SQL, and dbt.
• Experience building scalable ETL/ELT pipelines.
• Experience working with Kafka and JSON data.
• Familiarity with Apache Airflow.
• Strong understanding of data modeling (Star Schema/Dimensional Modeling).
• Experience leading technical initiatives and mentoring engineers.
• Excellent communication and collaboration skills.

Responsibilities

• Lead design and development of scalable data platforms on GCP for analytics and AI in Supply Chain/WMS.
• Mentor engineers and drive technical initiatives across the team.
• Collaborate with stakeholders to ensure robust data pipelines and governance.

Skills

BigQuery

Dataproc

SQL

dbt

ETL/ELT

Kafka

JSON data

Apache Airflow

Data modeling (Star Schema)

Mentoring Engineers

Communication & collaboration

Python

PySpark

CI/CD

Git

Tools

Git

CI/CD

Job description

TSR Consulting is currently seeking a highly motivated Lead Data Engineer for an Onsite opportunity in Pleasanton, CA

Duration: 17+ Months

Location: Pleasanton, CA

We are looking for a Lead Data Engineer to join our Supply Chain Data & AI team. In this role, you'll lead the design and development of scalable data platforms and pipelines on Google Cloud Platform (GCP) that power analytics and AI solutions for Supply Chain and Warehouse Management.

Required Skills:

• Design, develop, and maintain scalable data pipelines and data products on Google Cloud Platform (GCP).
• Strong experience with BigQuery, Dataproc, SQL, and dbt.
• Experience building scalable ETL/ELT pipelines.
• Experience working with Kafka and JSON data.
• Familiarity with Apache Airflow.
• Strong understanding of data modeling (Star Schema/Dimensional Modeling).
• Experience leading technical initiatives and mentoring engineers.
• Excellent communication and collaboration skills.

Preferred Skills:

• Python and PySpark.
• Experience with CI/CD, Git, and cloud engineering best practices.
• Experience in Retail, Apparel, Supply Chain, Warehouse Management (WMS), Transportation, or Logistics domains.

TSR Consulting offers all eligible employees a comprehensive benefits package including, but not limited to,

• major medical
• HSA
• dental
• vision
• employer-provided group life
• voluntary life insurance
• short-term disability
• long-term disability
• 401K

About TSR:

TSR is a trusted staffing and workforce solutions partner with more than 50 years of experience delivering highly qualified talent to support clients' most critical business and technology initiatives. Through a disciplined approach to sourcing, candidate vetting, and delivery, TSR helps organizations scale teams quickly while maintaining quality and reliability.

TSR operates with a global delivery model, leveraging specialized teams to support enterprise clients across North America and beyond.

In June 2024, TSR was acquired by Justin Christian, founder and CEO of BCforward, a global provider of professional services and workforce solutions.