Data Engineer [AQ-27366]

Aquent

San Mateo (CA)

On-site

USD 170,000 - 230,000

Full time

9 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

Aquent partners with a leader in autonomous mobility to recruit a data engineer who will design and operate scalable data pipelines for factory-floor analytics. You will implement CDC pipelines across SAP systems, on-premise sources, and cloud services, delivering robust Bronze/Silver/Gold models and semantic layers for BI and AI initiatives.

You will shape data architecture, monitor data quality, and collaborate across teams to enable real-time decision-making in advanced manufacturing.

Qualifications

  • 5–10 years of data engineering experience in manufacturing/industrial settings.
  • Deep experience with SAP (ERP/MES/HANA/SLT) within factory-floor data concepts.
  • Proficient in Python, PySpark, and SQL for production-grade pipelines.
  • Experience with Change Data Capture (CDC) pipelines and Medallion architecture.

Responsibilities

  • Design and build batch and streaming CDC pipelines from scratch, ingesting data from SAP, on-premises databases, AWS DMS, and PLCs.
  • Build Bronze/Silver/Gold layers and dimensional models for manufacturing operations (unit traceability, work orders, yield).
  • Develop incremental SQL and dbt models and process semi-structured payloads with Python and PySpark.
  • Monitor pipeline health, data quality, and SLAs with CloudWatch, Grafana, and automated tests.
  • Orchestrate production workflows with Apache Airflow and manage AWS ingestion infra (S3, IAM, DMS, Kinesis).
  • Collaborate with teams to build semantic layers powering BI dashboards and analytic apps.

Skills

Python
PySpark
SQL
Airflow
dbt
AWS
Kinesis
S3
SQL performance tuning

Tools

SAP
HANA
DMS
Grafana
Redshift
Databricks
Git
Terraform

Job description

Aquent has partnered with a pioneering leader in autonomous mobility and cutting-edge transportation technology to find an exceptional data professional ready to revolutionize factory-floor intelligence. In this high-impact role, you will have the unique opportunity to build critical data infrastructure from the ground up, directly influencing the production and scalability of next-generation vehicles. By bridging the gap between physical manufacturing operations and advanced cloud analytics, your work will empower real-time decision-making and drive the future of smart manufacturing.

The Opportunity and Your Impact

We are seeking a highly skilled and hands-on data expert with deep manufacturing domain expertise to design, build, and maintain robust data pipelines for a cutting-edge manufacturing operations lakehouse. Working alongside a collaborative team of innovators, you will be responsible for building Change Data Capture (CDC) pipelines from scratch, transforming raw factory-floor, supply chain, and production data into actionable insights. This role offers the perfect blend of technical ownership, complex data modeling, and operational observability, allowing you to make a tangible footprint on the future of industrial automation.

What You Will Do
  • Design and build batch and streaming Change Data Capture (CDC) pipelines from scratch, ingesting manufacturing operations data from SAP (MES, HANA, SLT), on-premises databases, AWS DMS, and industrial sources like PLCs.
  • Build and maintain Bronze, Silver, and Gold (Medallion) layers and dimensional models tailored to manufacturing operations—including unit traceability, work orders, non-conformance reporting, assembly line station results, logistics, and first-pass yield.
  • Develop incremental SQL and dbt models (including MERGE/upsert, SCD Type 2, and late-arriving data handling) and process semi-structured test and diagnostic payloads using Python and PySpark.
  • Monitor pipeline health, data quality, and freshness SLAs using AWS CloudWatch alarms, log monitoring, Grafana dashboards, and automated data quality tests.
  • Orchestrate production workflows using Apache Airflow and manage AWS ingestion infrastructure (S3, IAM, DMS, Kinesis) using Git-based CI/CD.
  • Collaborate with cross-functional teams to build semantic layers that power business intelligence dashboards and downstream analytical applications.
What You Bring
  • 5 to 10 years of hands-on data engineering experience.
  • Proven experience building data pipelines within manufacturing, industrial, automotive, or semiconductor operations.
  • Direct, hands-on experience working with SAP (ERP, MES, HANA, or SLT) and a deep understanding of factory-floor data concepts such as non-conformances, production testing/diagnostics, yield, work orders, or supply chain logistics.
  • Deep, hands-on experience building Change Data Capture (CDC) pipelines from scratch across relational databases and operational/industrial sources.
  • Strong proficiency in dimensional modeling, Medallion architecture (Bronze/Silver/Gold), and building semantic layers for analytics.
  • Advanced programming skills in Python, PySpark, and SQL, along with production experience in AWS (S3, DMS, Kinesis, CloudWatch, IAM) and workflow orchestration (Airflow or similar).
Bonus Points
  • Production experience with dbt, Amazon Redshift, Databricks, or Grafana.
  • Experience structuring lakehouse data to support AI and agentic applications.
Other Requirements

Applicants must be authorized to work for ANY employer in the U.S. We are unable to sponsor or take over sponsorship of an employment Visa at this time.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Data Engineer
Data Engineer

Aquent • Foster City (CA)

On-site
USD 180,000 - 240,000
Data Engineer [214448]
Data Engineer [214448]

Aquent Talent • Foster City (CA)

On-site
USD 95,000 - 105,000
Manufacturing Data Engineer: CDC & Lakehouse
Manufacturing Data Engineer: CDC & Lakehouse

Aquent Talent • Foster City (CA)

On-site
USD 95,000 - 105,000
Manufacturing Data Engineer — CDC Pipelines & Lakehouse
Manufacturing Data Engineer — CDC Pipelines & Lakehouse

Aquent • Foster City (CA)

On-site
USD 180,000 - 240,000
Director, Data Engineering
Director, Data Engineering

Dwyer Instruments, PTY • Michigan City (IN)

On-site
USD 180,000 - 240,000
Data Engineer - Fleet Operations
Data Engineer - Fleet Operations

HireArt, Inc. • Foster City (CA)

On-site
USD 150,000 - 210,000
Employer subsidized healthcare
Flexible Spending Account
Disability and life insurance coverage
+1
Manufacturing Data Engineer
Manufacturing Data Engineer

DeWinter BH • Foster City (CA)

On-site
USD 140,000 - 190,000
Senior Data Engineer
Senior Data Engineer

Camden Copper/Metis Endeavor • Camden (SC)

On-site
USD 120,000 - 160,000
Manufacturing Solution Architect
Manufacturing Solution Architect

Net2Source Inc. • Dallas (TX)

On-site
USD 100,000 - 130,000
Manufacturing Data Engineer
Manufacturing Data Engineer

Ursus, Inc. • Foster City (CA)

On-site
USD 94,000 - 107,000
Medical benefits
Dental benefits
Vision benefits
+2