Data Engineer - Fleet Operations (Onsite, Foster City)

Hireart; Foster City (CA); On-site; USD 78,000 - 110,000; Full time

Benefits offered by this job

Pre‑tax commuter benefits

Healthcare benefits

FSA for healthcare costs

Disability and life insurance covered

401k package

Job summary

HireArt is assisting an on-demand ride-hailing company in Foster City, CA to hire a Data Engineer - Fleet Operations. You will design, build, and maintain data pipelines and models powering the Manufacturing Intelligence data lakehouse and collaborate with cross-functional teams across data engineering, analytics, and operations.

The role emphasizes 80% hands-on data engineering with 20% on CI/CD, AWS ingestion infrastructure, Databricks configuration, and Redshift-to-Databricks migration,

Qualifications

• Bachelor's degree in computer science, information systems, engineering, or related discipline, or equivalent experience
• 6+ years of data engineering experience
• Strong proficiency in SQL, Python, and PySpark
• Hands-on production experience with Databricks, Delta Lake, Unity Catalog permissions, Workflows, and Spark tuning
• Production experience with dbt, including incremental modeling and testing
• Strong understanding of dimensional modeling, medallion architecture, CDC, and incremental data loading
• Experience deploying data code via Git-based workflows and CI/CD tools such as GitHub Actions or Databricks Asset Bundles
• Working knowledge of AWS data services (S3, IAM, DMS, Kinesis) and IaC tools like Terraform

Responsibilities

• Build and maintain batch and streaming ingestion pipelines into Delta Lake
• Design and maintain bronze, silver, and gold data layers following MOPS concepts
• Develop incremental dbt models on Databricks with MERGE, upsert, and SCD Type 2 patterns
• Model manufacturing data to support analytics, dashboards, and reporting
• Process large-scale datasets using PySpark and Databricks SQL, optimizing performance and costs
• Maintain data quality and pipeline reliability with tests, expectations, and monitoring
• Orchestrate data workloads with Databricks Workflows or Airflow and support migration from Redshift to Databricks
• Collaborate with analysts and manufacturing teams to define data requirements and document lineage
• Build and maintain CI/CD pipelines using Databricks Asset Bundles and GitHub Actions
• Manage Databricks configurations and governance in Unity Catalog
• Configure AWS ingestion infrastructure and coordinate Terraform provisioning
• Monitor pipeline health, performance, and DBU costs; maintain docs and incident response

Skills

SQL

Python

PySpark

Databricks

Delta Lake

Unity Catalog

dbt

CI/CD

AWS

Terraform

Education

Bachelor's degree in Computer Science, Information Systems, Engineering

Tools

Databricks

Delta Lake

Unity Catalog

dbt

GitHub Actions

Terraform

AWS

DMS

Kinesis

Job description

HireArt is assisting an on-demand ride-hailing company in Foster City, CA to hire a Data Engineer - Fleet Operations. You will design, build, and maintain data pipelines and models powering the Manufacturing Intelligence data lakehouse and collaborate with cross-functional teams across data engineering, analytics, and operations.

The role emphasizes 80% hands-on data engineering with 20% on CI/CD, AWS ingestion infrastructure, Databricks configuration, and Redshift-to-Databricks migration,