Data Loop Pipeline Engineer

Merlin Labs

Boston (MA)

On-site

USD 125,000 - 220,000

Full time

5 days ago
Be an early applicant
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Benefits offered by this job

Catered lunches
Snacks
Beverages

Job summary

Merlin Labs is hiring for a data engineering role focused on building and operating ingestion pipelines for flight test, simulation, and operational data. You will ensure data quality, time alignment, and full lineage of datasets used for ML training.

You will own labeling workflows, instrument deployed-system behavior, and collaborate with Flight Test & Operations to address data access constraints while monitoring pipeline health and coverage.

Qualifications

  • 3+ years in data engineering with production ownership of pipelines feeding ML training.
  • Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks.
  • Experience with dataset versioning and lineage tooling.
  • Comfort with high-volume time-series and multimodal sensor data.
  • Care about correctness; a data bug can drive model behavior.

Responsibilities

  • Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate.
  • Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool.
  • Build automated mining and triage for anomalies, disagreements between learned and rule-based systems, near-boundary events.
  • Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved.
  • Close the loop: instrument deployed-system behavior so that operational signal reaches the next training cycle.
  • Work with Flight Test & Operations on logging and instrumentation requirements, helping resolve access constraints.
  • Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage.

Skills

Data engineering
Python
SQL
Data modeling
Dataset versioning
Time-series data
High responsibility for data quality

Education

Bachelor's degree in CS/AI/Data Science/CE/Applied Math

Tools

Airflow
dbt

Job description

About Merlin:

Merlin (NASDAQ: MRLN) is a publicly traded aerospace and defense company building a non-human pilot to deliver full-stack autonomy for any aircraft from takeoff to touchdown. The Merlin Pilot autonomy system powers a growing range of aircraft and mission profiles and has been proven through hundreds of autonomous flights from Merlin's global flight test facilities, including Kerikeri, New Zealand; Quonset Point, Rhode Island; and soon, Bedford, Massachusetts. Headquartered in Boston, Merlin is expanding its organization to accelerate the development and deployment of its autonomy platform, helping customers solve some of aviation's most pressing challenges, from pilot shortages to improving flight safety. Backed by some of the world's leading investors prior to its public listing, Merlin continues to advance the certification and commercialization of autonomous flight across commercial and defense aviation.

About You:

You think data infrastructure is a craft. You have built pipelines that ran unattended for months and you have felt the specific satisfaction of a dataset that is exactly what it claims to be. You'd rather prevent a data problem than debug a model trained on one.

You will own themachinery that turns flight and simulation output into trustworthy, versioned, traceable training data — and turns deployed behavior back into the next training set.

Responsibilities:
  • Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate.
  • Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool.
  • Build automated mining and triage for the rare and interesting — anomalies, disagreements between learned and rule-based systems, near-boundary events — so the flywheel prioritizes signal over volume.
  • Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved.
  • Close the loop: instrument deployed-system behavior so that operational signal reliably reaches the next training cycle without manual shepherding.
  • Work with Flight Test & Operations on logging and instrumentation requirements, and help resolve access constraints where data is captured by third-party systems.
  • Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage.
Qualifications:
  • Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject.
  • 3+ years in data engineering, with production ownership of pipelines feeding ML training.
  • Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks.
  • Experience with dataset versioning and lineage tooling.
  • Comfort with high-volume time-series and multimodal sensor data — telemetry, video, audio, structured logs.
  • Care about correctness. In this role a quiet data bug becomes a model behavior nobody can explain.
Nice to Have:
  • Robotics, autonomous vehicle or aerospace data experience.
  • Familiarity with flight data formats and avionics bus data.
  • Experience building internal tools that engineers actually chose to use.
  • Data governance or provenance work in a regulated environment.

$125,000 - $220,000 a year

The compensation range provided is reflective of base salary only, and is a good-faith estimate based on a wide range of factors. The actual offer will be determined by a variety of factors including the candidate's qualifications, skills, experience, education, and training. Highly competitive equity grants are considered part of Merlin's total compensation package. Additionally, Merlin offers top-tier benefits for full-time employees.

This position is based on-site at Merlin HQ in Boston, MA.

Once you’re here, you’ll enjoy a variety of on-site perks designed to make your workday enjoyable and convenient. These include catered lunches featuring a rotating menu of delicious options, an assortment of snacks to keep you fueled throughout the day, and a selection of beverages, including coffee, tea, and other drinks, to keep you refreshed.

Our goal is to create an environment where you can thrive both professionally and personally

Merlin Labs offers an innovative, entrepreneurial, and team-focused startup environment. We also offer a top-notch benefits package (health, dental, life, unlimited vacation, and 401k with match) and work/life integration. Being part of the Merlin team allows you to become part of a small team that supports professional development while working together to achieve our mission.

Merlin Labs is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, religion, color, national origin, genetic information, sex (including pregnancy), gender, gender identity and expression, sexual orientation, age, marital status, military service or obligation or disability status, or any other characteristic protected by law. All job offers are contingent upon the candidate passing background and reference checks.

At this time, we are unable to provide visa sponsorship or consider candidates who require visa transfers. Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.

If you require reasonable accommodation in completing an application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to: people@merlinlabs.com

Merlin Labs does not accept unsolicited resumes from any source other than directly from candidates.

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Lead AI Dataloop and Release Engineer
Lead AI Dataloop and Release Engineer

Merlin Labs, Inc. • Boston (MA)

Hybrid
USD 220,000 - 290,000
Catered lunches
Snacks & drinks
Benefits package
Staff Engineer, World Model Development
Staff Engineer, World Model Development

Merlin Labs • Boston (MA)

On-site
USD 185,000 - 325,000
Catered lunches
Snacks on site
Beverages on site
+4
Director, AI Core Software
Director, AI Core Software

Quiet Capital • San Francisco (CA)

On-site
USD 252,000 - 360,000
Catered lunches
Snacks and beverages
401k with company match
+2
Staff Engineer, World Model Development
Staff Engineer, World Model Development

Merlinlabs • Boston (MA)

On-site
USD 160,000 - 230,000
Catered lunches
Snacks
Beverages
+3
Staff Engineer, World Model Development
Staff Engineer, World Model Development

Merlin • Boston (MA)

On-site
USD 150,000 - 230,000
Catered lunches
Snacks and beverages
On-site perks
Staff Software Engineer, AI Foundation Model
Staff Software Engineer, AI Foundation Model

Merlin • Boston (MA)

On-site
USD 180,000 - 260,000
Catered lunches
Snacks and beverages
Health, dental, life insurance
+2
Staff Software Engineer, AI Foundation Model
Staff Software Engineer, AI Foundation Model

Merlin Labs, Inc. • Boston (MA)

On-site
USD 180,000 - 240,000
Catered lunches
Snacks and beverages
Health, dental, life insurance
+2
Staff Software Engineer, AI Foundation Model
Staff Software Engineer, AI Foundation Model

Merlinlabs • Boston (MA), San Francisco (CA)

On-site
USD 180,000 - 240,000
Catered lunches
Snacks and beverages on-site
401k with match
+1
Autonomy Software Engineer
Autonomy Software Engineer

Merlin • Boston (MA)

On-site
USD 110,000 - 170,000
Health, dental, life insurance
Unlimited vacation
401k with match
Staff Engineer, World Model Development
Staff Engineer, World Model Development

Quiet Capital • Boston (MA)

On-site
USD 185,000 - 325,000
Catered lunches
Snacks provided
Beverages on site