Senior ML Data Pipeline Architect

LawZero; Montreal (administrative region); On-site; CAD 120,000 - 180,000; Full time

Job summary

LawZero, based in Montreal, seeks a Senior ML Data Processing Developer to own end-to-end data pipelines from raw web-scale data to high-signal training datasets. You will engineer quality through model-based scoring, filtering, and novel data transformations at the frontier of ML training data.

You will collaborate across Research, Engineering, and Legal teams to ensure compliance, scale, and data governance while building internal tooling for researchers to query and understand datasets.

Qualifications

• Degree in computer science, software engineering, or a related field.
• 5+ years of experience in data processing, machine learning engineering or NLP with massive unstructured text datasets.
• Hands-on experience with distributed processing frameworks (Spark, Ray, Flink).
• Strong Python proficiency and production-grade data-processing coding.
• Experience with pipeline orchestration frameworks (Airflow, Prefect, Dagster).
• Experience with data privacy implementation (PII scrubbing) and content-safety filtering.

Responsibilities

• Partner with Research to define, build, automate, scale, and manage data pipelines transforming raw data into training datasets.
• Build and maintain data processing pipelines with data quality, versioning, and provenance tracking at scale.
• Ensure ingested data meets governance, compliance and legal obligations.
• Develop scoring/filtering toolchain including heuristics, ML classifiers, and human-in-the-loop workflows.
• Instrument data pipelines with monitoring, guardrails, and alerting for regressions.
• Collaborate with Research, Engineering, and Legal teams to acquire datasets and manage licensing.
• Design leakage detection to guard against evaluation contamination across stages.
• Build tooling to allow researchers to query and understand datasets with minimal friction.

Skills

Python

Spark

Ray

Flink

Airflow

Prefect

Dagster

NLP

PII scrubbing

Data governance

Education

Bachelors in CS or related

Tools

Docker

Kubernetes

Weights & Biases

LLM tooling

Job description

LawZero, based in Montreal, seeks a Senior ML Data Processing Developer to own end-to-end data pipelines from raw web-scale data to high-signal training datasets. You will engineer quality through model-based scoring, filtering, and novel data transformations at the frontier of ML training data.

You will collaborate across Research, Engineering, and Legal teams to ensure compliance, scale, and data governance while building internal tooling for researchers to query and understand datasets.