Staff Data Engineer

Archer; San Jose (CA); On-site; USD 175,000 - 215,000; Full time

Job summary

Archer is seeking a Staff Data Engineer in San Jose to design, build, and operate data infrastructure that powers large-scale model training and inference. You will own pipelines, storage, and data quality mechanisms that sit upstream of our ML platform.

Collaborate with ML engineers and researchers to define feature stores, dataset versioning, and data contracts, and integrate with tools like MLflow for tracking artifacts and datasets.

Qualifications

• 5+ years of professional data engineering experience.
• BS/MS/PhD in Computer Science, Data Engineering, Software Engineering, or related field.
• Hands-on experience building production pipelines with Spark, Flink, Airflow, dbt or similar frameworks.
• Deep proficiency with columnar formats (Parquet) and open table formats (Iceberg/Paimon) and object storage (S3).
• Experience with real-time data ingestion using Kafka or Pulsar.
• Strong SQL skills; experience with StarRocks for large-scale analytics.

Responsibilities

• Design and maintain high-throughput ingestion and transformation pipelines for training workloads.
• Build and operate a data lakehouse with Iceberg/Paimon, Parquet, and partitioning strategies.
• Instrument pipelines with data quality checks, lineage, and anomaly detection.
• Collaborate with ML engineers to define feature stores, dataset versioning, and data contracts; integrate with MLflow.
• Work closely with researchers and platform engineers to optimize query performance and unblock training runs.

Skills

5+ years data engineering

SQL

High-throughput pipelines

Data governance

Feature stores

Education

BS/MS/PhD in CS/Data Eng/SE

Tools

Apache Spark

Apache Flink

Airflow

dbt

Parquet

Iceberg

Paimon

S3

Kafka/Pulsar

Job description

Archer is an aerospace company based in San Jose, California building an all-electric vertical takeoff and landing aircraft with a mission to advance the benefits of sustainable air mobility. We are designing, manufacturing, and operating an all-electric aircraft that can carry four passengers while producing minimal noise.

Our sights are set high and our problems are hard, and we believe that diversity in the workplace is what makes us smarter, drives better insights, and will ultimately lift us all to success. We are dedicated to cultivating an equitable and inclusive environment that embraces our differences, and supports and celebrates all of our team members.

Archer is best known for Midnight, our electric aircraft. This role isn't on that program. The AI Products Org is building software for the general aviation industry. As a Staff Data Engineer on the AI Platform team, you will design, build, and operate the data infrastructure that powers large-scale model training and inference. You will own the pipelines, storage systems, and data quality mechanisms that sit upstream of our ML platform, ensuring models train on clean, high-throughput, well-governed data.

What You’ll Do:

• Design and maintain high-throughput, fault-tolerant ingestion and transformation pipelines that feed training workloads at scale, with a focus on latency, throughput, and correctness.
• Build and operate the data lakehouse — defining table formats (Iceberg, Paimon, Parquet), partitioning strategies, and compaction policies optimized for ML consumption patterns.
• Instrument pipelines with data quality checks, lineage tracking, and anomaly detection so that model failures trace back to data problems quickly.
• Partner with ML engineers to define feature stores, dataset versioning, and experiment-to-production data contracts; integrate with tools like MLflow for dataset and artifact tracking.
• Work closely with AI researchers, platform engineers, and software engineers to understand data access patterns, optimize query performance, and unblock training runs.

What You Need:

• 5+ years of professional data engineering experience excluding internships.
• BS/MS/PhD in Computer Science, Data Engineering, Software Engineering, or a related field.
• Hands-on experience building production pipelines with tools like Apache Spark, Flink, Airflow, dbt, or similar batch/streaming frameworks.
• Deep proficiency with columnar formats (i.e. Parquet), open table formats (Apache Iceberg or Apache Paimon), and object storage systems (S3 or equivalent).
• Experience with high-throughput messaging systems such as Apache Pulsar or Kafka for real-time data ingestion.
• Strong SQL skills; experience with StarRocks for large-scale analytical queries and real-time analytics over the lakehouse.
• Familiarity with AWS data services (S3, Glue, EMR) and containerized workloads (Docker/Kubernetes) in production environments. Airflow/Prefect/Dagster

Bonus Qualifications:

• Experience with CDC (Change Data Capture) replication from transactional systems (i.e. PostgreSQL → Lakehouse via Debezium or Airbyte).
• Exposure to audio or time-series data pipelines, including preprocessing for ASR or speech model training.
• Prior experience in aerospace, aviation, or other safety-critical domains where data lineage and auditability are non-negotiable.

About The Team:

AI Products is a roughly 100-person software org inside a company of aerospace engineers, and we expect to grow substantially over the next year. You get the resources and momentum of a real org, but the products themselves are early — which means Data Engineers here get the kind of ownership that usually only exists at startups.

At Archer we aim to attract, retain, and motivate talent that possess the skills and leadership necessary to grow our business. We drive a pay-for-performance culture and reward performance that supports the Company’s business strategy. For this position we are targeting a base pay between $175,00.00 - $215,000.00 . Actual compensation offered will be determined by factors such as job-related knowledge, skills, and experience.

Archer is committed to working with and providing reasonable accommodations to job applicants with physical or mental disabilities, and those with sincerely held religious beliefs. Applicants who may require reasonable accommodation for any part of the application or hiring process should provide their name and contact information to Archer’s People Team [e-mail] . Reasonable accommodations will be determined on a case-by-case basis.

Information collected and processed as part of any job applications you choose to submit is subject to Archer's Candidate Privacy Policy .

Archer is unable to provide work visa sponsorship for this position at the present time.

Archer is proud to be an Equal Opportunity employer committed to diversity and inclusivity in the workplace. All aspects of employment are decided on the basis of merit, qualifications, and business needs. We do not discriminate based upon race, color, religion, sex, sexual orientation, age, national origin, disability status, protected veteran status, gender identity or any other characteristic protected by federal, state or local laws.

Archer Aviation does not engage with external recruiting agencies/individual recruiters with whom it does not have a prior written agreement. Archer reserves the right to make use of any unsolicited resumes that it receives and bears no responsibility for payment of any fees asserted from the use of unsolicited resumes. If you are a recruiting agency or individual recruiter wishing to do business with Archer, please reach out [e-mail] . All employment processes are managed by the Archer People Team.