Staff Data Engineer

archer56; San Jose (CA); On-site; USD 175,000 - 215,000; Full time

Job summary

Archer is seeking a Staff Data Engineer to join the AI Platform team in San Jose, CA. You’ll design, build, and operate data infrastructure powering large-scale model training and inference, owning pipelines, storage, and data quality for ML workloads.

Collaborate with ML engineers, researchers, and software engineers to optimize data access, feature stores, and contracts, while ensuring scalable, high-throughput data processing in a secure, compliant environment.

Qualifications

• 5+ years of professional data engineering experience excluding internships.

Responsibilities

• Design and maintain high-throughput, fault-tolerant ingestion and transformation pipelines that feed training workloads at scale, with a focus on latency, throughput, and correctness.

Tools

Apache Spark

Apache Flink

Airflow

dbt

Apache Iceberg

Apache Paimon

Parquet

S3

Kafka

Pulsar

StarRocks

AWS

Docker

Kubernetes

Job description

Archer is an aerospace company based in San Jose, California building an all-electric vertical takeoff and landing aircraft with a mission to advance the benefits of sustainable air mobility. We are designing, manufacturing, and operating an all-electric aircraft that can carry four passengers while producing minimal noise.

Our sights are set high and our problems are hard, and we believe that diversity in the workplace is what makes us smarter, drives better insights, and will ultimately lift us all to success. We are dedicated to cultivating an equitable and inclusive environment that embraces our differences, and supports and celebrates all of our team members.

Archer is best known for Midnight, our electric aircraft. This role isn't on that program. The AI Products Org is building software for the general aviation industry. As a Staff Data Engineer on the AI Platform team, you will design, build, and operate the data infrastructure that powers large-scale model training and inference. You will own the pipelines, storage systems, and data quality mechanisms that sit upstream of our ML platform, ensuring models train on clean, high-throughput, well-governed data.

What You'll Do:

• Design and maintain high-throughput, fault-tolerant ingestion and transformation pipelines that feed training workloads at scale, with a focus on latency, throughput, and correctness.
• Build and operate the data lakehouse - defining table formats (Iceberg, Paimon, Parquet), partitioning strategies, and compaction policies optimized for ML consumption patterns.
• Instrument pipelines with data quality checks, lineage tracking, and anomaly detection so that model failures trace back to data problems quickly.
• Partner with ML engineers to define feature stores, dataset versioning, and experiment-to-production data contracts; integrate with tools like MLflow for dataset and artifact tracking.
• Work closely with AI researchers, platform engineers, and software engineers to understand data access patterns, optimize query performance, and unblock training runs.

What You Need:

• 5+ years of professional data engineering experience excluding internships.
• BS/MS/PhD in Computer Science, Data Engineering, Software Engineering, or a related field.
• Hands-on experience building production pipelines with tools like Apache Spark, Flink, Airflow, dbt, or similar batch/streaming frameworks.
• Deep proficiency with columnar formats (i.e. Parquet), open table formats (Apache Iceberg or Apache Paimon), and object storage systems (S3 or equivalent).
• Experience with high-throughput messaging systems such as Apache Pulsar or Kafka for real-time data ingestion.
• Strong SQL skills; experience with StarRocks for large-scale analytical queries and real-time analytics over the lakehouse.
• Familiarity with AWS data services (S3, Glue, EMR) and containerized workloads (Docker/Kubernetes) in production environments. Airflow/Prefect/Dagster

Bonus Qualifications:

• Experience with CDC (Change Data Capture) replication from transactional systems (i.e. PostgreSQL → Lakehouse via Debezium or Airbyte).
• Exposure to audio or time-series data pipelines, including preprocessing for ASR or speech model training.
• Prior experience in aerospace, aviation, or other safety-critical domains where data lineage and auditability are non-negotiable.

About The Team:

• AI Products is a roughly 100-person software org inside a company of aerospace engineers, and we expect to grow substantially over the next year. You get the resources and momentum of a real org, but the products themselves are early - which means Data Engineers here get the kind of ownership that usually only exists at startups.

At Archer we aim to attract, retain, and motivate talent that possess the skills and leadership necessary to grow our business. We drive a pay-for-performance culture and reward performance that supports the Company's business strategy. For this position we are targeting a base pay between $175,00.00 - $215,000.00 . Actual compensation offered will be determined by factors such as job-related knowledge, skills, and experience.

Archer is committed to working with and providing reasonable accommodations to job applicants with physical or mental disabilities, and those with sincerely held religious beliefs. Applicants who may require reasonable accommodation for any part of the application or hiring process should provide their name and contact information to Archer's People Team at [e-mail] . Reasonable accommodations will be determined on a case-by-case basis.

Information collected and processed as part of any job applications you choose to submit is subject to Archer's Candidate Privacy Policy .

Archer is unable to provide work visa sponsorship for this position at the present time.

Archer is proud to be an Equal Opportunity employer committed to diversity and i