Senior Machine Learning Engineer- AIOS

Zafin; Toronto; On-site; CAD 120,000 - 180,000; Full time

Benefits offered by this job

Health benefits

Annual bonus

Generous vacation

RRSP matching

Insurance coverage

Wellness resources

Parmedical benefits

Job summary

Zafin in Toronto, Canada, seeks a Machine Learning Engineer for the AIOS Product team to build production ML systems powering the AIOS Knowledge Fabric and reliable AI outputs in regulated banking environments.

You will work with AI/data engineers, PMs, and domain experts to translate requirements into robust ML designs, write production-grade Python, and improve latency, cost, and observability in a hybrid work setting.

Qualifications

• 5+ years of software/ML production system experience.
• 2+ years with production ML, LLMs, or NLP.
• Strong Python programming and production-grade coding.
• Experience with ML frameworks, LLM APIs, embeddings, vector databases, and model serving.
• Understanding of data pipelines, feature/knowledge prep, model evaluation, and experiment tracking.
• Solid fundamentals: APIs, databases, testing, version control, system design.
• Ability to analyze model behavior and improve systems with metrics and reviews.
• Strong communication to explain ML trade-offs to product/engineering teams.
• Bachelor's degree in CS/Engineering/ML/Statistics or equivalent.

Responsibilities

• Design, build, test, and maintain ML/AI capabilities for AIOS, focusing on retrieval, integration, and production reliability.
• Develop embeddings, vector search, ranking, retrieval-augmented generation, knowledge ingestion, and quality improvements.
• Build model evaluation workflows, test sets, scoring, metrics, and monitoring for ML/LLM systems.
• Collaborate with AI/data engineers, PMs, architects, and domain experts to translate needs into ML designs.
• Write production-grade Python code and integration points with product systems.
• Improve ML performance, latency, cost, reliability, and observability in production/pre-production.
• Work with structured and unstructured enterprise data and documents.
• Support responsible AI with governance, privacy, and auditability workflows.
• Create technical docs, model cards, eval notes, and runbooks.
• Stay current with ML/LLM/Eval/MLOps practices and bring improvements to AIOS.

Skills

Software engineering

Machine learning engineering

Data science engineering

Production systems

Production ML

LLM applications

RAG

NLP

Search

Recommendation

AI automation

Python

ML frameworks

LLM APIs

Embeddings

Vector databases

Retrieval systems

Model serving

Data pipelines

Model evaluation

Experiment tracking

APIs

Databases

Testing

Version control

System design

Model analysis

Quality diagnostics

Communication

Bachelor's degree in CS

Engineering

Education

Bachelor's degree in Computer Science or related field

Tools

Azure

Kubernetes

Docker

Job description

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments.

Our portfolio includes Zafin AIOS, an agent orchestration platform for governed AI work; the Zafin Banking Platform, which helps banks modernize product, pricing, offers, billing, loyalty, and relationship management; and Zafin IO, an integration platform that connects data, systems, and workflows across complex enterprise environments.

Headquartered in Toronto, Canada, Zafin partners with leading financial institutions across North America, Europe, the Middle East, Africa, and Asia-Pacific. As AI transforms the future of financial services, we're building the platforms that help regulated organizations adopt AI responsibly and at scale.

What is the Opportunity?

As a Machine Learning Engineer, part of Zafin's AIOS Product team, you will build the machine learning and AI systems that power the AIOS Knowledge Fabric and help agents reason over enterprise knowledge with accuracy, traceability, and control.

You will work on practical production systems, including retrieval, ranking, embeddings, model integration, evaluation, data pipelines, model serving, observability, and the workflows that make AI outputs reliable for regulated banking environments. This is a hands-on engineering role focused on turning ML and LLM capabilities into dependable product infrastructure.

This role is critical for high-quality knowledge, strong evaluation, and reliable model behavior. You will help build the foundation that allows customers to use AI agents with confidence, accountability, and measurable business value.

What Will You Do?

• Design, build, test, and maintain ML and AI capabilities for AIOS, with a focus on knowledge retrieval, model integration, and production reliability.
• Develop systems for embeddings, vector search, ranking, retrieval-augmented generation, knowledge ingestion, and knowledge quality improvement.
• Build and improve model evaluation workflows, test sets, scoring approaches, quality metrics, and monitoring for AI and LLM-based systems.
• Partner with AI engineers, data engineers, product managers, architects, and domain experts to translate product needs into ML system designs and working software.
• Write production-quality Python or equivalent code, including services, pipelines, automation, tests, and integration points with product systems.
• Improve ML system performance, latency, cost, reliability, and observability in production and pre-production environments.
• Work with structured and unstructured enterprise data, including documents, metadata, knowledge sources, customer data, and operational signals.
• Support responsible AI practices by improving traceability, explainability, governance, auditability, privacy, and human review workflows.
• Create technical documentation, model cards or evaluation notes where useful, implementation guidance, and operational runbooks.
• Stay current with ML, LLM, RAG, evaluation, and MLOps practices and bring practical improvements into the AIOS product.

What Do You Need to Succeed?

Must haves

• 5 + years of software engineering, machine learning engineering, data science engineering, or applied ML experience building production systems.
• 2+ years of hands-on experience with production ML, LLM applications, retrieval-augmented generation, NLP, search, recommendation, or AI-powered automation.
• Strong programming skills in Python and experience building maintainable, tested, production-quality code.
• Practical experience with ML frameworks, LLM APIs or open-source models, embeddings, vector databases, retrieval systems, or model-serving patterns.
• Strong understanding of data pipelines, feature or knowledge preparation, model evaluation, experiment tracking, and performance measurement.
• Solid software engineering fundamentals, including APIs, databases, testing, debugging, version control, and system design.
• Ability to analyze model behavior, diagnose quality issues, and improve systems using both quantitative metrics and qualitative reviews.
• Strong communication skills, with the ability to explain ML trade-offs, model behavior, and technical recommendations to product and engineering stakeholders.
• Bachelor's degree in Computer Science , Engineering, Machine Learning, Statistics, Mathematics, or a related technical field, or equivalent practical experience.

Nice to have

• Experience building RAG systems, knowledge graphs, document understanding systems, semantic search, or enterprise knowledge platforms.
• Experience with MLOps practices, model monitoring, model registries, CI/CD for ML, or deployment of ML services in cloud environments.
• Experience with Azure, Kubernetes, Docker, distributed data processing, or scalable data infrastructure. Experience with banking, financial services, compliance, risk, or other regulated industry data.
• Experience with AI evaluation, safety testing, hallucination mitigation, prompt testing, or governance controls for LLM systems.
• Experience collaborating with product teams to turn ambiguous AI capabilities into usable product features.
• Experience with security, privacy, data access controls, audit trails, and responsible AI requirements.
• Published research, open-source contributions, patents, or technical writing related to ML, NLP, search, or AI systems.

Additional Job Details

At Zafin, we invest in our people. Our comprehensive rewards program is designed to support your health, financial well-being, and work-life balance, including:

• Fully company-paid health benefits
• Annual bonus opportunities
• Generous vacation and holidays
• RRSP matching
• Employer-paid insurance coverage
• Wellness resources
• Extensive paramedical benefits, and more

Vacancy Status: Open Position to be filled

Expected Salary range: Hiring for multiple levels depending on candidate's experience and competence

Mode of Work: Hybrid

Use of AI: Zafin may use Artificial Intelligence (AI) and/or other forms of automated technology to screen and/or assess applicants for this position. Zafin will not utilize AI for conducting interviews and/or making hiring decisions.

What's in it for you

Joining our team means being part of a culture that values diversity, teamwork, and high-quality work. We offer competitive salaries, annual bonus potential, generous paid time off, paid volunteering days, wellness benefits, and robust opportunities for professional growth and career advancement. Want to learn more about what you can look forward to during your career with us? Visit our careers site and our openings: zafin.com/careers

Zafin welcomes and encourages applications from people with disabilities. Accommodations are available on request for candidates taking part in all aspects of the selection process.

Zafin is committed to protecting the privacy and security of the personal information collected from all applicants throughout the recruitment process. The methods by which Zafin contains uses, stores, handles, retains, or discloses applicant information can be accessed by reviewing Zafin's privacy policy at https://zafin.com/privacy-notice/. By submitting a job application, you confirm that you agree to the processing of your personal data by Zafin described in the candidate privacy notice.