Data Loop Pipeline Engineer

Merlin; Boston (MA); Hybrid; USD 120,000 - 190,000; Full time

Benefits offered by this job

Health insurance

Dental insurance

Life insurance

Unlimited vacation

401k with match

Job summary

Merlin Labs seeks a data engineer to own ingestion pipelines for flight test, simulation, and operations data, ensuring accurate formatting, time alignment, and quality validation. You will curate datasets with full lineage and versioning, and build automated mining for anomalies to keep the training loop efficient.

You will instrument deployed-system data flow, support logging needs with Flight Test & Operations, and monitor pipeline health while collaborating with cross-functional teams at our

Qualifications

• Degree in Computer Science, AI, Data Science, Computer Engineering or Applied Math
• 3+ years in data engineering with production ownership of pipelines feeding ML training
• Strong Python and SQL; solid data modeling, storage formats and processing frameworks
• Experience with dataset versioning and lineage tooling
• Comfort with high-volume time-series and multimodal sensor data (telemetry, video, audio, logs)
• Care about correctness; a data bug can drive model behavior unexpectedness

Responsibilities

• Build and operate ingestion pipelines for flight test, simulation and operational data with format normalization and time alignment
• Implement dataset curation and versioning with full lineage
• Develop automated mining and triage for anomalies and near-boundary events to prioritize signal over volume
• Own labeling workflows and tooling, including quality control and inter-annotator agreement
• Close the loop by instrumenting deployed-system behavior so data reaches the next training cycle
• Collaborate with Flight Test & Operations on logging requirements and resolve access constraints
• Monitor pipeline health and dataset coverage; alert on drift and gaps

Skills

Data engineering

Python

SQL

Data modeling

Processing frameworks

Dataset versioning

Time-series data

Multimodal data

Education

Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math

Tools

Airflow

Spark

Pandas

Git

Job description

Merlin (NASDAQ: MRLN) is a publicly traded aerospace and defense company building a non-human pilot to deliver full-stack autonomy for any aircraft from takeoff to touchdown. The Merlin Pilot autonomy system powers a growing range of aircraft and mission profiles and has been proven through hundreds of autonomous flights from Merlin's global flight test facilities, including Kerikeri, New Zealand; Quonset Point, Rhode Island; and soon, Bedford, Massachusetts. Headquartered in Boston, Merlin is expanding its organization to accelerate the development and deployment of its autonomy platform, helping customers solve some of aviation's most pressing challenges, from pilot shortages to improving flight safety. Backed by some of the world's leading investors prior to its public listing, Merlin continues to advance the certification and commercialization of autonomous flight across commercial and defense aviation.

About You

• You think data infrastructure is a craft. You have built pipelines that ran unattended for months and you have felt the specific satisfaction of a dataset that is exactly what it claims to be. You'd rather prevent a data problem than debug a model trained on one
• You will own the machinery that turns flight and simulation output into trustworthy, versioned, traceable training data - and turns deployed behavior back into the next training set

Responsibilities

• Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate
• Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool
• Build automated mining and triage for the rare and interesting - anomalies, disagreements between learned and rule-based systems, near-boundary events - so the flywheel prioritizes signal over volume
• Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved
• Close the loop: instrument deployed-system behavior so that operational signal reliably reaches the next training cycle without manual shepherding
• Work with Flight Test & Operations on logging and instrumentation requirements, and help resolve access constraints where data is captured by third-party systems
• Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage

Qualifications

• Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject
• 3+ years in data engineering, with production ownership of pipelines feeding ML training
• Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks
• Experience with dataset versioning and lineage tooling
• Comfort with high-volume time-series and multimodal sensor data - telemetry, video, audio, structured logs
• Care about correctness. In this role a quiet data bug becomes a model behavior nobody can explain

Nice to Have

• Robotics, autonomous vehicle or aerospace data experience
• Familiarity with flight data formats and avionics bus data
• Experience building internal tools that engineers actually chose to use
• Data governance or provenance work in a regulated environment

Logistics

• We welcome remote applicants for this role, with a preference for candidates based in or willing to relocate to Boston, MA for a hybrid work schedule at our HQ

Merlin Labs offers an innovative, entrepreneurial, and team-focused startup environment. We also offer a top-notch benefits package (health, dental, life, unlimited vacation, and 401k with match) and work/life integration. Being part of the Merlin team allows you to become part of a small team that supports professional development while working together to achieve our mission.

Merlin Labs is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, religion, color, national origin, genetic information, sex (including pregnancy), gender, gender identity and expression, sexual orientation, age, marital status, military service or obligation or disability status, or any other characteristic protected by law. All job offers are contingent upon the candidate passing background and reference checks.

At this time, we are unable to provide visa sponsorship or consider candidates who require visa transfers. Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.

If you require reasonable accommodation in completing an application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to: [e-mail]

Merlin Labs does not accept unsolicited resumes from any source other than directly from candidates.

The compensation range provided is reflective of base salary only, and is a good-faith estimate based on a wide range of factors. The actual offer will be determined by a variety of factors including the candidate's qualifications, skills, experience, education, and training. Highly competitive equity grants are considered part of Merlin's total compensation package. Additionally, Merlin offers top-tier benefits for full-time employees.