Manufacturing Data Engineer — CDC Pipelines & Lakehouse

Aquent

Foster City (CA)

On-site

USD 180,000 - 240,000

Full time

6 days ago
Be an early applicant

Get a reply from this recruiter

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

Aquent partners with a leader in autonomous mobility to hire a data engineer for building scalable factory-floor data pipelines. You will create and maintain CDC pipelines from SAP and on-prem sources, design Medallion-style data layers, and enable real-time analytics for manufacturing operations.

You will work hands-on with Python, PySpark, SQL, and AWS services (S3, DMS, Kinesis), ensuring data quality, observability, and reliable CI/CD workflows.

Qualifications

  • 5 to 10 years of hands-on data engineering experience.
  • Proven experience building data pipelines within manufacturing, industrial, automotive, or semiconductor operations.
  • Direct, hands-on experience working with SAP and factory-floor data concepts.

Responsibilities

  • Design and build batch and streaming Change Data Capture (CDC) pipelines from scratch, ingesting manufacturing data from SAP, on-premises databases, AWS DMS, and PLCs.
  • Build and maintain Bronze, Silver, and Gold layers and dimensional models for manufacturing operations.
  • Develop incremental SQL and dbt models (MERGE/upsert, SCD Type 2) and process semi-structured payloads with Python and PySpark.
  • Monitor pipeline health, data quality, and freshness SLAs using CloudWatch, Grafana, and data quality tests.
  • Orchestrate production workflows with Apache Airflow and manage AWS ingestion infrastructure (S3, DMS, Kinesis) with CI/CD.
  • Collaborate with cross-functional teams to build semantic layers for dashboards and downstream analytics.

Skills

Data engineering
CDC pipelines
Python
PySpark
SQL
AWS
Airflow
Dimensional modeling

Tools

SAP (ERP/MES/HANA/SLT)
dbt
Grafana

Job description

Aquent partners with a leader in autonomous mobility to hire a data engineer for building scalable factory-floor data pipelines. You will create and maintain CDC pipelines from SAP and on-prem sources, design Medallion-style data layers, and enable real-time analytics for manufacturing operations.

You will work hands-on with Python, PySpark, SQL, and AWS services (S3, DMS, Kinesis), ensuring data quality, observability, and reliable CI/CD workflows.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Aquent • Foster City (CA)

On-site
USD 180,000 - 240,000
Manufacturing Data Engineer: CDC & Lakehouse
Manufacturing Data Engineer: CDC & Lakehouse

Aquent Talent • Foster City (CA)

On-site
USD 95,000 - 105,000
Data Engineer [214448]
Data Engineer [214448]

Aquent Talent • Foster City (CA)

On-site
USD 95,000 - 105,000
Manufacturing Data Engineer – Onsite, 12‑Month Contract
Manufacturing Data Engineer – Onsite, 12‑Month Contract

Comrise • Foster City (CA)

On-site
USD 78,000 - 110,000
Azure Data Engineer: Pipelines, Data Lakes & CDC
Azure Data Engineer: Pipelines, Data Lakes & CDC

Valiant Technologies LLC • Grand Rapids (MI)

On-site
USD 110,000 - 150,000
Senior Data Engineer: Cloud Pipelines (AWS/Snowflake) Remote
Senior Data Engineer: Cloud Pipelines (AWS/Snowflake) Remote

Jobs360 • United States

Remote
USD 120,000 - 160,000
Free Parking
Shuttle Service
Premium Game Lounge
+6
Data Engineer III - Manufacturing Analytics & ML Pipelines
Data Engineer III - Manufacturing Analytics & ML Pipelines

Amazon Fulfillment Technologies & Robotics • Bellevue (WA)

On-site
USD 120,000 - 170,000
Manufacturing Data Engineer
Manufacturing Data Engineer

WorkGenius Group • San Mateo (CA)

On-site
USD 96,000 - 152,000
Manufacturing Data Engineer
Manufacturing Data Engineer

DeWinter BH • Foster City (CA)

On-site
USD 140,000 - 190,000
Manufacturing Data Engineer - Databricks Lakehouse Onsite
Manufacturing Data Engineer - Databricks Lakehouse Onsite

Ursus, Inc. • Foster City (CA)

On-site
USD 94,000 - 107,000
Medical benefits
Dental benefits
Vision benefits
+2