11834

Maarut; Toronto; On-site; CAD 65,000 - 95,000; Full time

Job summary

Maarut is seeking an Intermediate Software Developer to support the Ontario Data Platform transformation, focusing on data science and AI/ML initiatives. The role involves running batch inferences, monitoring experiments, and collaborating with teams across government data projects.

The candidate should have a CS/DS/AI/ML background, be proficient in Python and ML libraries, and familiar with Databricks/MLflow or cloud ML environments, with strong attention to detail for tracking experiments.

Qualifications

• Background in Computer Science, Data Science, or AI/ML.
• Python and libraries like pandas, scikit-learn, or PyTorch.
• Familiarity with DSPy, LangChain, Hugging Face, or equivalent.
• Experience with Databricks / MLflow or cloud ML environments.
• Detail-oriented with strong ability to track experiments.

Responsibilities

• Run and monitor batch inference jobs on Databricks and other environments.
• Troubleshoot inference issues, log results, and escalate model anomalies.
• Assist with running DSPy pipelines and loading custom models/configs.
• Support evaluation runs using internal metrics.
• Track and summarize performance metrics for inference experiments.
• Help prepare and clean legal text datasets for inference and evaluation.
• Annotate outputs to support error analysis and benchmarking.
• Maintain reproducible scripts/notebooks for inference runs.

Skills

CS/DS/AI/ML basics

Python

LLM frameworks

Databricks/MLflow

Experiment tracking

Education

CS/DS/AI/ML degree

Tools

Databricks

Job description

RQ11828 - Software Developer - Intermediate

The Government of Ontario is embarking on a large Data &AI transformation initiative. Core to the transformation is the enablement ofthe Ontario Data Platform (ODP), which is being developed as the enterprisetechnology ecosystem for everything Data & AI. ODP is a modern ecosystem ofdata solution consisting of data ingestion technologies, storage, processingand visualization as well as solutions related to data governance, quality,marketplace, etc. ODP will initially serve all internal government clusters,ministries and program areas, but also external agencies in the future. We arelooking for a data scientist to support various initiatives related to theplatform as well as the execution of use cases to support the needs of variousbusinesses within the government.

Key Responsibilities:

Run and Monitor Inferences:

• Execute batch inference jobs on Databricks and otherenvironments.
  


• Troubleshoot inference issues, log results, and escalatemodel anomalies.
  


• Assist with running DSPy pipelines and loading custommodels/configs.
  


• Support evaluation runs using internal metrics
  


• Track and summarize performance metrics for inferenceexperiments.
  


• Help prepare and clean legal text datasets for inference andevaluation.
  


• Annotate outputs to support error analysis and benchmarking.
  


• Maintain reproducible scripts/notebooks for inference runs.
  

Requirements

Experience and Skill Set Requirements:

Must Haves:

• Background in Computer Science, Data Science, or AI/ML(student or recent grad is good).
  


• Familiarity with Python and libraries like pandas,scikit-learn, or PyTorch.
  


• Exposure to LLM frameworks (DSPy, LangChain, Hugging Face,or equivalent).
  


• Comfortable working with Databricks / MLflow or other cloudML environments.
  


• Detail-oriented with strong organizational skills fortracking experiments.
  

Skill Set Requirements:

Qualifications:

• Background in Computer Science, Data Science, or AI/ML (student or recent grad is good).
  


• Familiarity with Python and libraries like pandas,scikit-learn, or PyTorch.
  


• Exposure to LLM frameworks (DSPy, LangChain, HuggingFace, or equivalent).
  


• Comfortable working with Databricks / MLflow or othercloud ML environments.
  


• Detail-oriented with strong organizational skills fortracking experiments.