Data Loop Pipeline Engineer

Openkrill; United States; Remote; USD 120,000 - 160,000; Full time

Job summary

Merlin Labs is seeking a Data Engineer to build ingestion pipelines for flight test, simulation, and operational data, ensuring exacting data quality and full lineage for ML training. You will own labeling workflows and monitor pipeline health.

Remote-friendly with a Boston HQ hybrid option;5+ years in data engineering and strong Python/SQL are essential for this role.

Qualifications

• Degree in Computer Science, AI, Data Science, Computer Engineering, Applied Math, or related subject.
• 3+ years in data engineering with production ownership of pipelines feeding ML training.
• Strong Python and SQL; solid grasp of data modelling, storage formats and processing frameworks.
• Experience with dataset versioning and lineage tooling.
• Comfort with high-volume time-series and multimodal sensor data — telemetry, video, audio, structured logs.
• Care about correctness; a data bug can become a model behavior.

Responsibilities

• Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate.
• Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool.
• Build automated mining and triage for anomalies, disagreements between learned and rule-based systems, near-boundary events to prioritize signal over volume.
• Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved.
• Close the loop: instrument deployed-system behavior so that operational signal reaches next training cycle without manual shepherding.
• Work with Flight Test & Operations on logging and instrumentation requirements, and help resolve access constraints where data is captured by third-party systems.
• Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage.

Skills

Python

SQL

Data modelling

Data lineage

Dataset versioning

ML data pipelines

Telemetry data

Education

Degree in Computer Science / AI / Data Science

Job description

About You:

• You think data infrastructure is a craft. You have built pipelines that ran unattended for months and you have felt the specific satisfaction of a dataset that is exactly what it claims to be. You'd rather prevent a data problem than debug a model trained on one.
• You will own the machinery that turns flight and simulation output into trustworthy, versioned, traceable training data — and turns deployed behavior back into the next training set.

Responsibilities:

• Build and operate ingestion pipelines for flight test, simulation and operational data, including format normalization, time alignment across sources, and quality validation at the gate.
• Implement dataset curation and versioning with full lineage: what went into a dataset, from where, processed how, and by which version of which tool.
• Build automated mining and triage for the rare and interesting — anomalies, disagreements between learned and rule-based systems, near-boundary events — so the flywheel prioritizes signal over volume.
• Own labeling workflows and tooling, including quality control and inter-annotator agreement where human labeling is involved.
• Close the loop: instrument deployed-system behavior so that operational signal reliably reaches the next training cycle without manual shepherding.
• Work with Flight Test & Operations on logging and instrumentation requirements, and help resolve access constraints where data is captured by third-party systems.
• Monitor pipeline health and dataset coverage; alert on drift, gaps and silent breakage.

Qualifications:

• Degree in Computer Science, Artificial Intelligence, Data Science, Computer Engineering, Applied Math, or a related subject.
• 3+ years in data engineering, with production ownership of pipelines feeding ML training.
• Strong Python and SQL; solid grasp of data modeling, storage formats and processing frameworks.
• Experience with dataset versioning and lineage tooling.
• Comfort with high-volume time-series and multimodal sensor data — telemetry, video, audio, structured logs.
• Care about correctness. In this role a quiet data bug becomes a model behavior nobody can explain.

Nice to Have:

• Robotics, autonomous vehicle or aerospace data experience.
• Familiarity with flight data formats and avionics bus data.
• Experience building internal tools that engineers actually chose to use.
• Data governance or provenance work in a regulated environment.

Logistics:

• We welcome remote applicants for this role, with a preference for candidates based in or willing to relocate to Boston, MA for a hybrid work schedule at our HQ.

Merlin Labs offers an innovative, entrepreneurial, and team-focused startup environment. We also offer a top-notch benefits package (health, dental, life, flexible paid time off, and 401k with match) and work/life integration. Being part of the Merlin team allows you to become part of a small team that supports professional development while working together to achieve our mission.

Merlin Labs is an equal opportunity employer and values diversity. We do not discriminate on the basis of race, religion, color, national origin, genetic information, sex (including pregnancy), gender, gender identity and expression, sexual orientation, age, marital status, military service or obligation or disability status, or any other characteristic protected by law. All job offers are contingent upon the candidate passing background and reference checks.

At this time, we are unable to provide visa sponsorship or consider candidates who require visa transfers. Applicants must be authorized to work in the United States without the need for visa sponsorship now or in the future.

In compliance with federal law, all persons hired will be required to verify identity and eligibility to work in the United States and to complete the required employment eligibility verification form upon hire.

If you require reasonable accommodation in completing an application, interviewing, completing any pre-employment testing, or otherwise participating in the employee selection process, please direct your inquiries to: [e-mail]

Merlin Labs does not accept unsolicited resumes from any source other than directly from candidates.