Senior Software Engineer, Data Platform

Matterworks, Inc.; Somerville (MA); Ibrido; USD 150.000 - 210.000; Tempo pieno

Vantaggi offerti da questo lavoro

Health & Dental

Vision

Disability

Life Insurance

401k Match

Flexible Work

Commuter Benefits

Parking

Team Meals

Conferences

Descrizione del lavoro

Matterworks, Inc. is seeking a Senior Software Engineer to build the connective tissue of our data platform, enriching raw samples into datasets with biological context.

You will collaborate with ML researchers, scientists, and product teams on data pipelines, feature enrichment, and scalable data services. You will own pipelines, data contracts, and interfaces, while ensuring quality, cost efficiency, and secure data processing across the platform.

Competenze

• Significant professional experience building production data systems and pipelines
• Proficient in Python and SQL for large-scale data processing
• Proficient in Kubernetes-native batch orchestration and modern data lake technologies (Argo Workflows, Metaflow, EKS, Glue, Athena, Apache Iceberg, Parquet, DuckDB, Terraform)
• Experience with LLM or agent components in production data paths, including eval loop and cost per record
• Daily use of AI coding tools and skepticism about production data correctness
• Owned work to running, validated systems, including backfills and debugging publish steps
• Comfort with messy scientific formats and toolchains (mzML, RDKit, ProteoWizard)
• Autonomy and eagerness to learn in an early-stage startup environment

Mansioni

• Build and scale data contracts and pipelines for petabytes of data
• Scale data serving with cost-conscious storage, layout, and orchestration in Kubernetes
• Turn raw data into usable datasets with consistent schemas and metadata
• Automate quality gates to prevent regressions
• Own interfaces used by AI, chemistry, product, and agents
• Ensure operations meet SLAs with provenance and secure data processing

Conoscenze

Data pipelines

Python

SQL

Kubernetes

Argo Workflows

Metaflow

Airflow

LLMs in production

Problem solving

Data quality

Strumenti

Argo Workflows

Metaflow

EKS

Glue

Athena

Apache Iceberg

Parquet

DuckDB

Terraform

Airflow

Dagster

Descrizione del lavoro

About Us

Most of the molecules driving human biology are invisible to us. Mass spectrometers already detect metabolites, lipids, and peptides, but the vast majority of those signals never get identified. A typical experiment names a small fraction of its features and discards the rest. We call this biology's dark matter. It’s signal-rich and mechanism-defining, yet almost entirely opaque.

Matterworks is building the foundation models that make that dark matter legible. Our Large Spectral Models do for biochemical biology what AlphaFold and ESM did for proteins: turning a library-bound discipline into something predictable and generative, and embedding it at every stage of R&D.

Come build the future of biological discovery with us.

Position Overview

As a Senior Software Engineer you’ll work to build the connective tissue of our data platform, in both what you build and how you build it. Design, build and scale systems to enrich data from raw samples and information into readily usable datasets enriched with biological context. The data produced by you and the team will serve our customers through both our ML research and model development activities as well as our product.

You will report to the Head of Engineering and work daily with our machine learning researchers, scientists, and product team.

Key Responsibilities

• Build and Scale Data Contracts: Own the pipelines and system other teams consume from. Design and implement systems that scale to multiple petabytes of data in an effective way.

• Serving and Cost at Scale: You will build and scale systems to acquire, store and serve data in a fast and affordable as it grows: data layout, featurization throughput, Kubernetes-native orchestration, and cost surfaced before it adds up.

• Labels and Enrichment: Turn raw data into datasets people can use, with consistent schemas, trustworthy metadata, and documented definitions. Scale scientific labels from studies down to their spectra and underlying features.

• Quality Gates: Automate quality checks that enable increasing capability without regression and promote only on a pass.

• Interfaces People Use: Own the surfaces AI, chemistry, product, and agents call, from the SDK used to build datasets to the tools that expose platform capabilities.

• Operations and Data Rights: Ensure effective operations of our data needs meeting our designed service level agreements, while providing high quality, provenance, and secure data processing in line with our customer needs.

About You

• Significant professional experience building production data systems and pipelines. We level on scope and judgment rather than years.

• Proficient in Python and SQL for large-scale data processing.

• Proficient in Kubernetes-native batch orchestration and modern data lake technologies (Argo Workflows, Metaflow, EKS, Glue, Athena, Apache Iceberg, Parquet, DuckDB, Terraform). Airflow or Dagster experience transfers fine.

• Demonstrated experience designing stable identifiers for a large, changing corpus, and building validation that gates a publish rather than reporting on it after the fact.

• Experience putting an LLM or agent component into a production data path, including the eval loop, the gold set, and cost per record.

• Daily use of AI coding tools, paired with healthy scepticism about their output on questions of production data correctness.

• A track record of owning work through to a running, validated system, including the unglamorous parts: fixing the malformed dataset, writing backfill, debugging last night's bad publish.

• Comfort with messy scientific formats and toolchains (mzML, RDKit, ProteoWizard or similar). Engineering depth is the requirement.

• A passion for contributing to an early-stage startup where autonomy, eagerness to learn, and enthusiasm for solving novel scientific challenges prevail over rigid processes and egos.

Working at Matterworks

Given the cross-disciplinary and innovative nature of our work, effective collaboration and communication are critical to our progress. We operate in a flexible hybrid model that accommodates both fully remote team members and those who work full-time from our Somerville, MA office. While some positions may require regular in-person presence for hands-on work or local collaboration, many roles can be performed remotely with team members distributed across various locations.

Compensation and Benefits

Matterworks offers full-time employees a competitive base salary, stock options, and benefits (health & dental, vision, long- and short-term disability, life insurance, 401k with company match). Employees enjoy a flexible work & unlimited time away policy, commuter benefits and parking, regular team meals and outings, and company support for continued education/coursework and conference participation.

Matterworks, Inc. is an equal opportunity employer. All candidates for employment at Matterworks are considered without regard to race, color, religion, national origin, age, sex, marital status, ancestry, physical or mental disability, veteran status, gender identity, sexual orientation, or any other category protected by law.