Senior Software Engineer, AI Products

HRB; Kitchener; On-site; CAD 110,000 - 150,000; Full time

Job summary

HRB in the Waterloo region of Canada is seeking an experienced Backend Software Engineer focused on ML and Gen-AI to design and ship AI-driven features. You will work on production-grade code, optimize models, and ensure reliable deployments.

You will collaborate with product, engineering and data teams to define use cases, build scalable ML/LLM pipelines, and balance performance with cost, delivering impactful AI solutions for customers.

Qualifications

• 5+ years as Backend Software Engineer with ML/Gen-AI experience.
• Production experience with LLMs and prompt engineering.
• Strong Python and vector DB skills (FAISS, Pinecone, Weaviate).
• Experience with Django, cloud platforms and testing (pytest) preferred.
• MLOps experience: deployment, monitoring, scaling in production.
• Able to collaborate with product, engineering and data teams.

Responsibilities

• Build and ship AI-based features for the platform.
• Develop LLM-powered automation and tooling to streamline workflows.
• Design and maintain scalable ML/LLM infrastructure.
• Optimize performance and infrastructure costs.
• Collaborate cross-functionally with product, engineering and data teams.

Skills

Backend Software Engineer

ML/Gen-AI expertise

LLM technologies

Prompt engineering

Collaboration & communication

Problem-solving mindset

Tools

Python

Vector databases (FAISS, Pinecone, Weaviate)

Django

AWS/GCP

pytest

Job description

What You Will Be Doing:

• Build & Ship AI Based Features – Design, implement, and optimize AI-driven features for the platform, enhancing customer experience and business impact.
• AI-Powered Automation & Tooling – Develop LLM-based internal automation tools to streamline workflows, reduce manual effort, and improve team productivity.
• Scalable AI Infrastructure – Build and maintain a ML/LLM pipeline, ensuring robust, efficient, and scalable deployments.
• Performance & Cost Optimization – Improve AI model performance, balancing speed, quality, and infrastructure costs.
• Cross-Functional Collaboration – Work with product, engineering, and data teams to define AI/LLM use cases and share best practices.

What We’re Looking For:

• 5+ years of technical experience: 5+ years of experience as a Backend Software engineer working directly with ML and Gen-AI or similar. Prior startup experience is preferred but not required.
• Strong LLM & ML Expertise: Experience working with LLM technologies (AWS Bedrock, OpenAI, Anthropic, Hugging Face models, or Llama etc.) in production and proficiency with prompt engineering, model selection, and ML/AI observability.
• Technology Skills: Proficiency in Python, vector databases (FAISS, Pinecone, Weaviate), and retrieval-augmented generation (RAG) pipelines. Experience with Django, AWS/GCP, and pytest preferred but not required.
• MLOps Experience: Familiarity with AI model deployment, monitoring, and scaling in production environments.
• Problem-Solving Mindset: Ability to tackle ambiguous AI challenges and develop scalable, efficient AI solutions.
• Collaboration & Communication: Comfortable working with engineers, data scientists, and product teams to define and implement AI-driven features.

Infra:

AWS, Fargate, Redis, PostgreSQL, SQS, CDK, Github, retool