Senior Data & AI Platform Engineer

Maarut; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

The Government of Ontario is launching a Data & AI transformation through the Ontario Data Platform. We seek a data scientist to support platform initiatives, run inferences, and help evaluate models in Databricks and cloud ML environments.

The role emphasizes reproducible scripts, dataset preparation, and performance tracking for inference experiments within a government data ecosystem.

Qualifications

• Background in Computer Science, Data Science, or AI/ML (student or recent grad is good).
• Familiarity with Python and libraries like pandas, scikit-learn, or PyTorch.
• Exposure to LLM frameworks (DSPy, LangChain, Hugging Face, or equivalent).

Responsibilities

• Run and Monitor Inferences
• Execute batch inference jobs on Databricks and other environments.
• Troubleshoot inference issues, log results, and escape model anomalies.
• Assist with running DSPy pipelines and loading custom models/configs.
• Support evaluation runs using internal metrics
• Track and summarize performance metrics for inference experiments.
• Help prepare and clean legal text datasets for inference and evaluation.
• Annotate outputs to support error analysis and benchmarking.
• Maintain reproducible scripts/notebooks for inference runs.

Skills

Python

Pandas

Scikit‑learn

PyTorch

DSPy

LangChain

Hugging Face

Databricks

MLflow

Education

BSc in CS/DS/AI or related field

Tools

Databricks

MLflow

Job description

The Government of Ontario is launching a Data & AI transformation through the Ontario Data Platform. We seek a data scientist to support platform initiatives, run inferences, and help evaluate models in Databricks and cloud ML environments.

The role emphasizes reproducible scripts, dataset preparation, and performance tracking for inference experiments within a government data ecosystem.