Data Engineer

Aquent

Foster City (CA)

On-site

USD 180,000 - 240,000

Full time

6 days ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aquent partners with a leader in autonomous mobility to hire a data engineer for building scalable factory-floor data pipelines. You will create and maintain CDC pipelines from SAP and on-prem sources, design Medallion-style data layers, and enable real-time analytics for manufacturing operations.

You will work hands-on with Python, PySpark, SQL, and AWS services (S3, DMS, Kinesis), ensuring data quality, observability, and reliable CI/CD workflows.

Qualifications

  • 5 to 10 years of hands-on data engineering experience.
  • Proven experience building data pipelines within manufacturing, industrial, automotive, or semiconductor operations.
  • Direct, hands-on experience working with SAP and factory-floor data concepts.

Responsibilities

  • Design and build batch and streaming Change Data Capture (CDC) pipelines from scratch, ingesting manufacturing data from SAP, on-premises databases, AWS DMS, and PLCs.
  • Build and maintain Bronze, Silver, and Gold layers and dimensional models for manufacturing operations.
  • Develop incremental SQL and dbt models (MERGE/upsert, SCD Type 2) and process semi-structured payloads with Python and PySpark.
  • Monitor pipeline health, data quality, and freshness SLAs using CloudWatch, Grafana, and data quality tests.
  • Orchestrate production workflows with Apache Airflow and manage AWS ingestion infrastructure (S3, DMS, Kinesis) with CI/CD.
  • Collaborate with cross-functional teams to build semantic layers for dashboards and downstream analytics.

Skills

Data engineering
CDC pipelines
Python
PySpark
SQL
AWS
Airflow
Dimensional modeling

Tools

SAP (ERP/MES/HANA/SLT)
dbt
Grafana

Job description

Aquent has partnered with a pioneering leader in autonomous mobility and cutting-edge transportation technology to find an exceptional data professional ready to revolutionize factory-floor intelligence. In this high-impact role, you will have the unique opportunity to build critical data infrastructure from the ground up, directly influencing the production and scalability of next-generation vehicles. By bridging the gap between physical manufacturing operations and advanced cloud analytics, your work will empower real-time decision-making and drive the future of smart manufacturing.

About the Opportunity

We are seeking a highly skilled and hands-on data expert with deep manufacturing domain expertise to design, build, and maintain robust data pipelines for a cutting-edge manufacturing operations lakehouse. Working alongside a collaborative team of innovators, you will be responsible for building Change Data Capture (CDC) pipelines from scratch, transforming raw factory-floor, supply chain, and production data into actionable insights. This role offers the perfect blend of technical ownership, complex data modeling, and operational observability, allowing you to make a tangible footprint on the future of industrial automation.

What You Will Do
  • Design and build batch and streaming Change Data Capture (CDC) pipelines from scratch, ingesting manufacturing operations data from SAP (MES, HANA, SLT), on-premises databases, AWS DMS, and industrial sources like PLCs.
  • Build and maintain Bronze, Silver, and Gold (Medallion) layers and dimensional models tailored to manufacturing operations—including unit traceability, work orders, non-conformance reporting, assembly line station results, logistics, and first-pass yield.
  • Develop incremental SQL and dbt models (including MERGE/upsert, SCD Type 2, and late-arriving data handling) and process semi-structured test and diagnostic payloads using Python and PySpark.
  • Monitor pipeline health, data quality, and freshness SLAs using AWS CloudWatch alarms, log monitoring, Grafana dashboards, and automated data quality tests.
  • Orchestrate production workflows using Apache Airflow and manage AWS ingestion infrastructure (S3, IAM, DMS, Kinesis) using Git-based CI/CD.
  • Collaborate with cross-functional teams to build semantic layers that power business intelligence dashboards and downstream analytical applications.
What You Bring (Required)
  • 5 to 10 years of hands-on data engineering experience.
  • Proven experience building data pipelines within manufacturing, industrial, automotive, or semiconductor operations.
  • Direct, hands-on experience working with SAP (ERP, MES, HANA, or SLT) and a deep understanding of factory-floor data concepts such as non-conformances, production testing/diagnostics, yield, work orders, or supply chain logistics.
  • Deep, hands-on experience building Change Data Capture (CDC) pipelines from scratch across relational databases and operational/industrial sources.
  • Strong proficiency in dimensional modeling, Medallion architecture (Bronze/Silver/Gold), and building semantic layers for analytics.
  • Advanced programming skills in Python, PySpark, and SQL, along with production experience in AWS (S3, DMS, Kinesis, CloudWatch, IAM) and workflow orchestration (Airflow or similar).
Bonus Points (Preferred)
  • Production experience with dbt, Amazon Redshift, Databricks, or Grafana.
  • Experience structuring lakehouse data to support AI and agentic applications.
Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer [214448]
Data Engineer [214448]

Aquent Talent • Foster City (CA)

On-site
USD 95,000 - 105,000
Manufacturing Data Engineer: CDC & Lakehouse
Manufacturing Data Engineer: CDC & Lakehouse

Aquent Talent • Foster City (CA)

On-site
USD 95,000 - 105,000
Manufacturing Data Engineer — CDC Pipelines & Lakehouse
Manufacturing Data Engineer — CDC Pipelines & Lakehouse

Aquent • Foster City (CA)

On-site
USD 180,000 - 240,000
Manufacturing Data Engineer
Manufacturing Data Engineer

WorkGenius Group • San Mateo (CA)

On-site
USD 96,000 - 152,000
Data Engineer (Manufacturing and Operations)
Data Engineer (Manufacturing and Operations)

Comrise • Foster City (CA)

On-site
USD 78,000 - 110,000
Director, Data Engineering
Director, Data Engineering

Dwyer Instruments, PTY • Michigan City (IN)

On-site
USD 180,000 - 240,000
Senior Data Engineer
Senior Data Engineer

Camden Copper/Metis Endeavor • Camden (SC)

On-site
USD 120,000 - 160,000
Manufacturing Data Engineer
Manufacturing Data Engineer

DeWinter BH • Foster City (CA)

On-site
USD 140,000 - 190,000
Manufacturing Solution Architect
Manufacturing Solution Architect

Net2Source Inc. • Dallas (TX)

On-site
USD 100,000 - 130,000
Senior Data Engineer
Senior Data Engineer

Principal Mineral Holdings • Camden (SC)

On-site
USD 120,000 - 180,000