Manufacturing Data Engineer: Delta Lake & Databricks Expert

Kforce Inc

San Mateo (CA)

Presencial

USD 150.000 - 190.000

Jornada completa

hace 3 horas
Sé de los primeros/as/es en solicitar esta vacante

Consigue una respuesta de este empleador

Tu currículum y tu carta de presentación, adaptados exactamente a lo que buscan contratar.

Supera los filtros ATS

Descripción de la vacante

Kforce is seeking a Manufacturing Data Engineer in Foster City, CA to design and maintain a medallion data architecture (bronze, silver, gold) in Delta Lake and Databricks. You will build batch and streaming ingestion, implement dbt models, and optimize queries for analytics across manufacturing data such as WOs, yield, and nonconformances.

Responsibilities include migrating Redshift models to Databricks, enforcing data quality, and collaborating with analysts and stakeholders to document

Formación

  • Bachelor's degree or equivalent practical experience + 6+ years in data engineering.

Responsabilidades

  • Build batch and streaming ingestion into Delta Lake using Auto Loader, Lakeflow Declarative Pipelines, Lakeflow Connect or Structured Streaming.
  • Design and maintain bronze, silver and gold (medallion) layers following MOPS naming conventions and data dictionary standards.
  • Build incremental dbt models on Databricks using MERGE and upsert patterns, SCD Type 2, handling late or out-of-order records.
  • Model manufacturing data for analytics (SFC, work orders, nonconformances, station results, yield) and feed the semantic layer for analysts.
  • Process large and semi-structured data (JSON payloads) using PySpark and Databricks SQL.
  • Tune pipeline performance and cost via partitioning, OPTIMIZE, VACUUM, and right-sized compute.
  • Own data quality with dbt tests, Lakeflow expectations and Lakehouse Monitoring; set freshness SLAs.
  • Orchestrate workloads with Databricks Workflows or Airflow.
  • Migrate Redshift models/pipelines to Databricks and cut over.
  • Document lineage, data contracts and table definitions in Unity Catalog with stakeholders.
  • Build and maintain CI/CD for MOPS jobs, pipelines and dbt models with Databricks Asset Bundles and GitHub Actions.

Conocimientos

SQL
Python
Data modeling
ETL

Educación

Bachelor's degree in CS/IS/Engineering

Herramientas

Databricks
Delta Lake
Unity Catalog
Databricks Workflows
GitHub Actions
Terraform
AWS DMS

Descripción del empleo

Kforce is seeking a Manufacturing Data Engineer in Foster City, CA to design and maintain a medallion data architecture (bronze, silver, gold) in Delta Lake and Databricks. You will build batch and streaming ingestion, implement dbt models, and optimize queries for analytics across manufacturing data such as WOs, yield, and nonconformances.

Responsibilities include migrating Redshift models to Databricks, enforcing data quality, and collaborating with analysts and stakeholders to document

Consigue la evaluación confidencial y gratuita de tu currículum.

o arrastra y suelta tu archivo aquí

Similar jobs

Puestos de trabajo similares que vale la pena comparar

Manufacturing Data Engineer - Databricks Lakehouse Onsite
Manufacturing Data Engineer - Databricks Lakehouse Onsite

Ursus, Inc. • Foster City (CA)

Presencial
USD 94.000 - 107.000
Medical benefits
Dental benefits
Vision benefits
+2
Manufacturing Data Engineer
Manufacturing Data Engineer

Kforce Inc • San Mateo (CA)

Presencial
USD 150.000 - 190.000
Manufacturing Data Engineer: Lakehouse & Streaming
Manufacturing Data Engineer: Lakehouse & Streaming

An Autonomous Mobility Company • Foster City (CA)

Presencial
USD 83.000 - 107.000
Pre‑tax commuter benefits
Healthcare benefits (HireArt)
Flexible Spending Account
+2
Manufacturing Data Engineer
Manufacturing Data Engineer

DeWinter BH • Foster City (CA)

Presencial
USD 140.000 - 190.000
Manufacturing Data Engineer
Manufacturing Data Engineer

Ursus, Inc. • Foster City (CA)

Presencial
USD 94.000 - 107.000
Medical benefits
Dental benefits
Vision benefits
+2
Fleet Operations Data Engineer — Databricks & Delta Lake
Fleet Operations Data Engineer — Databricks & Delta Lake

HireArt, Inc. • Foster City (CA)

Presencial
USD 150.000 - 210.000
Employer subsidized healthcare
Flexible Spending Account
Disability and life insurance coverage
+1
Data Engineer - Fleet Operations
Data Engineer - Fleet Operations

HireArt, Inc. • Foster City (CA)

Presencial
USD 150.000 - 210.000
Employer subsidized healthcare
Flexible Spending Account
Disability and life insurance coverage
+1
Data Engineer
Data Engineer

Aquent • Foster City (CA)

Presencial
USD 180.000 - 240.000
Data Engineer – Manufacturing Lakehouse (On-Site)
Data Engineer – Manufacturing Lakehouse (On-Site)

Apex Systems, LLC • Foster City (CA)

Presencial
USD 90.000 - 107.000
Data Engineer [AQ-27366]
Data Engineer [AQ-27366]

Aquent • San Mateo (CA)

Presencial
USD 170.000 - 230.000