AI Engineer

BDO Canada LLP; Toronto; Hybrid; CAD 77,000 - 117,000; Full time

Job summary

BDO Canada LLP is seeking an experienced AI Engineer to design, build, and deploy production-grade AI solutions that bridge experimental ML with scalable software engineering. You will focus on LLMs, retrieval-augmented generation (RAG), and agentic workflows within governance frameworks.

You will collaborate with AI Architects, ML Engineers, Data Scientists, and full-stack developers to deliver enterprise-ready AI capabilities, supported by ISO/IEC 42001 governance and strong data governance

Qualifications

• 3–5 years of professional AI/ML or applied software engineering experience.
• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
• Expert-level proficiency in Python; working familiarity with Java and/or TypeScript for enterprise development.
• Hands-on experience with leading AI/LLM frameworks and OpenAI APIs.
• Proven experience designing retrieval-augmented generation (RAG) and agentic AI systems.
• Experience with vector databases and cloud platforms (Azure AI, AWS Bedrock, GCP).
• Experience with Docker, Kubernetes, and CI/CD for ML workloads.
• Familiarity with ML lifecycle tools like MLflow or Weights & Biases.

Responsibilities

• Design, build, and deploy production-grade AI applications using LangChain, LlamaIndex, AutoGPT and related tools.
• Develop and optimize prompt strategies; manage model contexts; fine-tune models as needed.
• Integrate AI capabilities into enterprise environments via RESTful APIs and microservices.
• Build and optimize vector databases and embed pipelines to support RAG.
• Monitor production AI systems, addressing latency, reliability, and cost issues.
• Collaborate with AI Architects, ML Engineers, Data Scientists, and developers on firm-wide initiatives.
• Support AI governance, risk management, and documentation in line with ISO/IEC 42001.

Skills

Python

LLM frameworks

Prompt engineering

System design

DevOps culture

Education

Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Tools

LangChain

LlamaIndex

AutoGPT

Pinecone

Milvus

Weaviate

RESTful APIs

Docker

Kubernetes

CI/CD

MLflow

Weights & Biases

Job description

Putting people first, every day BDO is a firm built on a foundation of positive relationships with our people and our clients. Each day, our professionals provide exceptional service, helping clients with advice and insight they can trust. In turn, we offer an award-winning environment that fosters a people‑first culture with a high priority on your personal and professional growth.

Your Opportunity

As an experienced AI Engineer, you will design, build, and deploy production‑grade AI solutions that bridge experimental machine learning with scalable software engineering. In this replacement role, you will play a critical role in enabling enterprise‑ready AI capabilities with a strong focus on large language models (LLMs), retrieval‑augmented generation (RAG), and agentic workflows, operating within established governance frameworks.

Responsibilities

• Design, build, and deploy robust, scalable, production‑grade AI applications using frameworks such as LangChain, LlamaIndex, AutoGPT, and related LLM orchestration tools.
• Develop, refine, and optimize complex prompt strategies; manage model context windows; and fine‑tune models where required to maximize performance, accuracy, and cost efficiency.
• Integrate AI capabilities into existing enterprise environments through RESTful APIs, microservices, and cloud‑native architectures.
• Build, maintain, and optimize vector databases (e.g., Pinecone, Milvus, Weaviate) and design efficient data ingestion and embedding pipelines to support retrieval‑augmented generation (RAG) solutions.
• Monitor AI systems in production and proactively address issues related to hallucinations, latency, reliability, scalability, and token‑cost optimization.
• Collaborate closely with AI Architects, AI Studio Leads, ML Engineers, Data Scientists, Full‑Stack Developers, Service Line Labs, and Citizen Developers on firm‑wide initiatives and internal platforms.
• Support AI system documentation, lifecycle management, and control processes in alignment with ISO/IEC 42001 enterprise governance requirements.
• Adhere to established AI risk management, data governance, and security policies, and assist with model inventories, traceability, and change‑management activities.
• Participate in model testing and validation activities in accordance with the NIST AI Risk Management Framework, including mapping and measuring model risks.
• Support the implementation of risk‑mitigation controls and ongoing monitoring, and follow governance processes that promote transparency, accountability, and responsible AI use.

Qualifications

• Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field, with 3–5 years of professional experience in AI, machine learning, or applied software engineering.
• Expert‑level proficiency in Python, with working familiarity in Java and/or TypeScript for enterprise application development.
• Deep hands‑on experience with leading AI and LLM frameworks, including OpenAI APIs, Anthropic, Hugging Face, and LangGraph, along with a strong understanding of LLM‑based application design.
• Proven experience designing and implementing retrieval‑augmented generation (RAG) and agentic AI systems, supported by a solid grasp of scalable, production‑grade AI architectures.
• Experience working with vector databases as well as SQL and NoSQL data stores, and hands‑on exposure to cloud platforms such as Azure AI / AI Foundry, AWS Bedrock, or Google Cloud Platform (GCP).
• Practical experience with DevOps and MLOps practices, including Docker, Kubernetes, and CI/CD pipelines for machine learning workloads.
• Familiarity with machine learning lifecycle and experiment‑tracking tools such as MLflow or Weights & Biases.

The expected range of compensation for this role is $77,000 to $117,000 annually.

Why BDO?

Our people‑first approach to talent has earned us a spot among Canada’s Top 100 Employers for 2026. This recognition is a milestone we’re thrilled to add to our collection of awards for both experienced and student talent experiences. Our firm is committed to providing an environment where you can be successful in the following ways:

• We enable you to engage with how we change and evolve, being a key contributor to the success and growth of BDO in Canada.
• We help you become a better professional within our services, industries, and markets with extensive opportunities for learning and development.
• We support your achievement of personal goals outside of the office and making an impact on your community.
• Giving back adds up: Where company meets community.
• BDO is actively involved in our communities by supporting local charity initiatives.
• We support staff with local and national events where you will be given the opportunity to contribute to your community.
• Total rewards that matter: We pay for performance with competitive total cash compensation that recognizes and rewards your contribution.
• We provide flexible benefits from day one, and a market leading personal time off policy.
• We are committed to supporting your overall wellness beyond working hours and provide reimbursement for wellness initiatives that fit your lifestyle.
• Everyone counts: We believe every employee should have the opportunity to participate and succeed.

Through leadership by our Diversity, Equity and Inclusion Leader, we are committed to a workplace culture of respect, inclusion, and diversity.

We recognize and celebrate the valuable differences among each of us, including race, religious beliefs, physical or mental disabilities, age, place of origin, marital status, family status, gender or gender identity and sexual orientation.

If you require accommodation to complete the application process, please contact us.

Flexibility

All BDO personnel are expected to spend some of their time working in the office, at the client site, and virtually unless accommodations or alternative work arrangements are in place. Our model is a blended approach designed to support the flexible needs of our people, the firm and our clients. It’s about creating work experiences that meet everyone’s needs and providing flexibility to adjust when, where and how we work to meet the expectations of our role.

Code of Conduct

Our Code of Conduct sets clear standards for how we conduct business. It reflects our shared values and commitments and includes guiding principles to help us make ethical decisions and maintain trust with each other, our clients, and the public. BDO may use artificial intelligence enabled tools to support certain aspects of the recruitment process. While these tools assist our teams, our use of AI does not replace human decision making, and all employment‑related outcomes are made by BDO personnel. More information on BDO Canada’s Privacy Policy can be found here: Privacy Policy | BDO Canada

When it comes to our people, we believe in helping you unlock possibilities, build your passions, and grow your competitive edge. From our expansive client base to growing talent pool, our people are the core of BDO. Our multi‑award winning talent experience continues to make us proud. Our culture is open and collaborative. We foster inclusive ways to thinking and celebrate diversity among all contributors. We respect each other, do all things with integrity, and support our people to be their most authentic selves.