Manufacturing Data Engineer: Lakehouse & Streaming

An Autonomous Mobility Company

Foster City (CA)

Presencial

USD 83.000 - 107.000

Jornada completa

Hace 2 días
Sé de los primeros/as/es en solicitar esta vacante

Una candidatura completa en un minuto

Currículum y carta de presentación personalizados, listos para enviar.

Supera los filtros ATS

Ventajas ofrecidas por este puesto de trabajo

Pre‑tax commuter benefits
Healthcare benefits (HireArt)
Flexible Spending Account
Disability and life insurance
401k package

Descripción de la vacante

An Autonomous Mobility Company in Foster City, CA is seeking a senior data engineer to design, build, and maintain batch and streaming ingestion pipelines for manufacturing intelligence and fleet operations. You will develop incremental dbt models on Databricks and implement SCD Type 2 patterns to handle late or out-of-order records.

The role requires 6+ years in data engineering, strong SQL/Python, and hands-on Databricks experience.

Formación

  • Bachelor’s degree in computer science, information systems, engineering, or related discipline or equivalent experience.
  • 6+ years of data engineering experience.
  • Strong proficiency in SQL, Python, and PySpark.
  • Hands-on production experience with Databricks, Delta Lake, Unity Catalog permissions, Workflows, and Spark tuning.
  • Production experience with dbt, including incremental modeling and testing.
  • Strong understanding of dimensional modeling, medallion architecture, CDC, and incremental data loading.
  • Experience with Git-based workflows and CI/CD tools like GitHub Actions or Databricks Asset Bundles.
  • Working knowledge of AWS data services (S3, IAM, DMS, Kinesis) and Terraform.

Responsabilidades

  • Design, build, and maintain batch and streaming ingestion pipelines into Delta Lake.
  • Implement CDC feeds from AWS DMS and SAP SLT.
  • Set up bronze, silver, and gold data layers following MOPS naming conventions and data dictionary standards.
  • Develop incremental dbt models on Databricks using MERGE and upsert patterns.
  • Apply SCD Type 2 patterns in dbt, including late/out-of-order records support.
  • Model manufacturing datasets to support analytics: unit-level traceability, work orders, nonconformances, station results, first-pass yield.
  • Process large-scale data with PySpark and Databricks SQL; optimize performance and cost.

Conocimientos

SQL proficiency
Python proficiency
Data engineering

Educación

Bachelor’s degree in CS/IS/Engineering

Herramientas

Databricks
Delta Lake
Unity Catalog
Airflow
GitHub Actions
Terraform
DMS
Kinesis
S3
IAM

Descripción del empleo

An Autonomous Mobility Company in Foster City, CA is seeking a senior data engineer to design, build, and maintain batch and streaming ingestion pipelines for manufacturing intelligence and fleet operations. You will develop incremental dbt models on Databricks and implement SCD Type 2 patterns to handle late or out-of-order records.

The role requires 6+ years in data engineering, strong SQL/Python, and hands-on Databricks experience.

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Manufacturing Data Engineer - Databricks Lakehouse Onsite
Manufacturing Data Engineer - Databricks Lakehouse Onsite

Ursus, Inc. • Foster City (CA)

Presencial
USD 94.000 - 107.000
Medical benefits
Dental benefits
Vision benefits
+2
Manufacturing Data Engineer: Delta Lake & Databricks Expert
Manufacturing Data Engineer: Delta Lake & Databricks Expert

Kforce Inc • San Mateo (CA)

Presencial
USD 150.000 - 190.000
Data Engineer – Manufacturing Lakehouse (On-Site)
Data Engineer – Manufacturing Lakehouse (On-Site)

Apex Systems, LLC • Foster City (CA)

Presencial
USD 90.000 - 107.000
Data Engineer - Fleet Operations
Data Engineer - Fleet Operations

HireArt, Inc. • Foster City (CA)

Presencial
USD 150.000 - 210.000
Employer subsidized healthcare
Flexible Spending Account
Disability and life insurance coverage
+1
Manufacturing Data Engineer
Manufacturing Data Engineer

DeWinter BH • Foster City (CA)

Presencial
USD 140.000 - 190.000
Fleet Operations Data Engineer — Databricks & Delta Lake
Fleet Operations Data Engineer — Databricks & Delta Lake

HireArt, Inc. • Foster City (CA)

Presencial
USD 150.000 - 210.000
Employer subsidized healthcare
Flexible Spending Account
Disability and life insurance coverage
+1
Data Engineer - Fleet Operations (Onsite, Foster City)
Data Engineer - Fleet Operations (Onsite, Foster City)

Hireart • Foster City (CA)

Presencial
USD 78.000 - 110.000
Pre‑tax commuter benefits
Healthcare benefits
FSA for healthcare costs
+2
Senior Data Engineer: Lakehouse & Streaming Pipelines
Senior Data Engineer: Lakehouse & Streaming Pipelines

Robotics Technologies • Atlanta (GA)

Presencial
USD 120.000 - 180.000
Data Engineer - Fleet Operations
Data Engineer - Fleet Operations

Hireart • Foster City (CA)

Presencial
USD 78.000 - 110.000
Pre‑tax commuter benefits
Healthcare benefits
FSA for healthcare costs
+2
Remote Data Engineer: Databricks Lakehouse & MDM
Remote Data Engineer: Databricks Lakehouse & MDM

Lakefusion • EE. UU.

A distancia
USD 19.000 - 32.000