AI Engineer - Generative & Agentic AI

BDO Canada; Ottawa; On-site; CAD 84,000 - 128,000; Full time

Job summary

A leading consulting firm in Ontario is seeking an AI Engineer with a strong software engineering background to design and implement AI solutions. You will work closely with cross-functional teams and leverage cutting-edge technology. Candidates should have experience in Generative AI, LLMs, and cloud-native deployments. The salary range for this role is between $84,000 and $128,000, with opportunities for professional growth in an inclusive workplace.

Qualifications

• Strong background in system design and distributed systems.
• Hands-on expertise with LLMs and model fine-tuning.
• Experience architecting solutions on Azure, AWS, or GCP.

Responsibilities

• Build scalable AI applications using LLMs.
• Integrate workflows and existing software ecosystems.
• Apply LLM evaluation methodologies for continuous improvement.

Skills

Software engineering

Generative AI experience

LLM expertise

Vector databases

LLM orchestration frameworks

Programming (Python or .NET)

Cloud-native solutions

Tools

Pinecone

LangChain

n8n

Job description

AI Engineer

We are seeking an experienced AI Engineer with a strong foundation in software engineering and a proven track record of building Generative and Agentic AI solutions. This new role is ideal for someone who thrives at the intersection of software development, applied AI research, and practical solution design. You will be responsible for designing, implementing, and deploying production‑grade AI systems that leverage the latest in large language models (LLMs), orchestration frameworks, and agentic architectures.

Key Responsibilities

• Design & Development
  • Build scalable and robust AI‑driven applications using LLMs and agentic frameworks.
  • Implement vector database solutions to enable semantic search, RAG (retrieval augmented generation), and knowledge management.
  • Develop orchestration pipelines with frameworks like LangChain, Semantic Kernel, AutoGen, or emerging agentic frameworks such as Agno and Parlant.
• Automation & Integration
  • Integrate workflow automation platforms with AI systems to deliver end‑to‑end business solutions.
  • Ensure seamless integration with existing enterprise software ecosystems and APIs.
• Quality & Evaluation
  • Apply or contribute to LLM evaluation methodologies, leveraging platforms like Arize, DeepEval, or IBM WatsonX for model benchmarking, monitoring, and continuous improvement.
  • Establish best practices for testing, performance tuning, and evaluation of agentic/LLM‑based workflows.
• Collaboration & Delivery
  • Work closely with cross‑functional teams including data scientists, software engineers, and product owners.
  • Translate business requirements into technical designs and deliver working AI‑powered applications in production environments.

Required Skills & Qualifications

• Strong background in software engineering (e.g., system design, distributed systems, APIs, CI/CD).
• Proven experience in building Generative AI and/or agentic systems.
• Hands‑on expertise with
  • LLMs and model fine‑tuning or integration.
  • Vector databases (e.g., Pinecone, Weaviate, Milvus, FAISS).
  • LLM orchestration frameworks (LangChain, Semantic Kernel, AutoGen).
  • Agentic frameworks (Pydantic AI, Agno, Parlant).
• Proficiency in at least one major programming language such as Python or .NET.
• Experience architecting, deploying, and operating cloud‑native solutions on a major hyperscale platform (Azure, AWS, or GCP).
• Experience with workflow automation tools (n8n, dify.ai, Power Automate).

Nice-to-Have Skills

• Familiarity with LLM evaluation frameworks (Arize, DeepEval, IBM WatsonX).
• Contributions to open‑source AI frameworks or communities.
• Experience in MLOps, monitoring, and model deployment pipelines.

Who You Are

• A problem‑solver with strong engineering rigor and curiosity for cutting‑edge AI.
• Comfortable moving between architecture, coding, and deployment.
• Passionate about transforming abstract business needs into intelligent, production‑ready systems.

Salary

Salary range for this role is between $84,000 and $128,000.

Equal Opportunity Employer

We believe every employee should have the opportunity to participate and succeed. Through leadership by our Diversity, Equity and Inclusion Leader, we are committed to a workplace culture of respect, inclusion, and diversity. We recognize and celebrate the valuable differences among each of us, including race, religious beliefs, physical or mental disabilities, age, place of origin, marital status, family status, gender or gender identity, and sexual orientation. If you require accommodation to complete the application process, please contact us.