AI Engineer

Armilla AI; Toronto; On-site; CAD 90,000 - 130,000; Full time

Job summary

Armilla AI in Toronto is seeking an experienced AI Engineer to build our core AI-powered tools and the programmatic platforms used to rigorously evaluate AI systems. You will collaborate with senior AI/ML scientists and product managers to design, develop, and deploy end-to-end AI stacks, including UI/UX components and cloud-based evaluation infrastructures.

This role offers a dynamic startup environment in Liberty Village with opportunities for growth in AI risk assessment and cross-functional

Qualifications

• Strong engineering skills with a proven software development track record.
• Deep knowledge of AI model lifecycle and model evaluation.
• Experience building and optimizing AI pipelines for product development and evaluation.
• Experience applying software engineering best practices to ML projects.
• Proficient in end-to-end software stacks (UI/Backend) and cloud deployment.

Responsibilities

• Collaborate with senior AI/ML Scientists and Product Managers to design, build and maintain an adversarial AI evaluation platform.
• Architect and implement programmatic platforms for evaluating AI models, assessing performance, robustness and risks.
• Deploy and manage AI applications and evaluation infrastructures on CSPs (AWS, GCP, Azure).
• Collaborate with data scientists, actuaries, and product managers to translate complex requirements into robust technical solutions.
• Develop and integrate UI/UX components for internal tools and evaluation platforms.
• Troubleshoot, debug and optimize existing AI systems for performance and stability.
• Apply software engineering best practices to ML projects (version control, tests, reviews, CI/CD).
• Ensure scalable data flow, model training, inference, and evaluation processes.

Skills

Strong engineering skills

AI model lifecycle

AI pipelines

ML software engineering practices

End-to-end software stacks

Cloud deployment (AWS/GCP/Azure)

Python programming

TensorFlow / PyTorch / scikit-learn

Problem solving

Communication & collaboration

Tools

TensorFlow

PyTorch

scikit-learn

CI/CD tooling

Job description

Armilla AI is a cutting-edge startup based in Toronto, Ontario, Canada, operating at the intersection of artificial intelligence and insurance. We're not just talking about AI risk; we're actively building the solutions to manage, underwrite, and insure it. Our dynamic team is passionate about pioneering the future of AI risk management through the development of sophisticated AI-powered tools and programmatic evaluation platforms.

The Role: Building & Evaluating AI Solutions

We're looking for a talented and experienced AI Engineer to join our growing team. This is a pivotal role where you'll be instrumental in both building our core AI-powered tools and developing the programmatic platforms to rigorously evaluate AI systems . If you're passionate about applying robust engineering principles to AI, creating end-to-end solutions, and building systems for comprehensive AI assessment, we want to talk to you.

Role Responsibilities

In this exciting role, you'll:

• Collaborate with senior AI/ML Scientists and Product Managers to design, build and maintain an adversarial AI evaluation platform.
• This role requires a combination of strong engineering skills, product development experience, and AI/ML process-flow knowledge.
• Architect and implement programmatic platforms for evaluating AI models , assessing their performance, robustness, and potential risks.
• Implement and optimize AI pipelines , ensuring efficient data flow, model training, inference, and evaluation processes.
• Apply software engineering best practices to machine learning (ML) projects, including version control, automated testing, code reviews, and continuous integration/continuous deployment (CI/CD).
• Develop and integrate UI/UX components to ensure seamless and intuitive user experiences for both our internal tools and evaluation platforms.
• Deploy and manage AI applications and evaluation infrastructures on various Cloud Service Providers (CSPs) like AWS, GCP, or Azure, ensuring scalability, reliability, and security.
• Collaborate closely with data scientists, actuaries, and product managers to translate complex requirements into robust technical solutions for both building and evaluating AI.
• Troubleshoot, debug, and optimize existing AI systems to improve performance and stability.

What We’re Looking For

We're seeking a candidate who brings:

• Strong engineering skills with a proven track record in software development.
• Solid understanding of AI model lifecycle and especially concepts around AI model evaluations
• In-depth knowledge of AI pipelines and experience in building, managing, and optimizing them for both product development and evaluation.
• Demonstrable experience applying software engineering best practices to ML projects .
• Proficiency in creating end-to-end software stacks , including front-end (UI/UX) and back-end development.
• Hands‑on experience with deployment and management on major Cloud Service Providers (CSPs) such as AWS, GCP, or Azure.
• Strong programming skills in languages like Python .
• Experience with relevant AI/ML frameworks and libraries (e.g., TensorFlow, PyTorch, scikit-learn).
• Exceptional problem-solving abilities and a commitment to producing high‑quality, maintainable code.
• Strong communication and collaboration skills, with the ability to work effectively in a cross‑functional team.

What’s In It For You

• Pioneering a New Frontier: You’ll have a significant impact on our core products and infrastructure, shaping how AI risks are understood and managed globally.
• Diverse Technical Challenges: You’ll work on both developing cutting‑edge AI tools and building sophisticated systems for AI evaluation.
• Collaborative Environment: Be part of a highly skilled and supportive team that values innovation and continuous learning in a fast‑paced startup.
• Dynamic Work Environment: Enjoy a hybrid work environment based in Toronto’s trendy Liberty Village, fostering a collaborative and innovative atmosphere.
• Professional Growth: This role offers immense opportunities for personal and professional development in the burgeoning field of AI risk.
• Access to Cutting‑Edge Tooling: You’ll have access to your choice of leading AI models (e.g., GPT), operating systems, and cloud compute services to empower your work.