Senior Software Engineer, AI Products

HRB; Kitchener; On-site; CAD 80,000 - 110,000; Full time

Job summary

A technology company in Kitchener is seeking an experienced AI Engineer to integrate large language models into their platform. You will design AI-driven features, develop automation tools, and build scalable ML infrastructures, requiring strong expertise in LLM technologies. Candidates should have over 5 years of experience in backend software engineering and a solid understanding of Python and machine learning practices.

Qualifications

• 5+ years as a Backend Software Engineer with ML experience.
• Strong proficiency in working with LLM technologies in production.
• Technology skills in Python and vector databases.

Responsibilities

• Design and implement AI-driven features for the platform.
• Develop internal automation tools for efficiency.
• Build and maintain ML/LLM pipelines for deployments.

Skills

LLM technologies

Machine Learning

Python

Problem-Solving

Collaboration

Tools

AWS

Django

PostgreSQL

Github

Job description

The role

As an AI Engineer, you will play a pivotal role in integrating large language models (LLMs) and machine learning (ML) solutions into our platform and internal systems. Your work will directly impact customer experiences, operational efficiency, and product innovation.

What You Will Be Doing:

• Build & Ship AI Based Features – Design, implement, and optimize AI-driven features for the platform, enhancing customer experience and business impact.

• AI-Powered Automation & Tooling – Develop LLM-based internal automation tools to streamline workflows, reduce manual effort, and improve team productivity.

• Scalable AI Infrastructure – Build and maintain a ML/LLM pipeline, ensuring robust, efficient, and scalable deployments.

• Performance & Cost Optimization – Improve AI model performance, balancing speed, quality, and infrastructure costs.

• Cross-Functional Collaboration – Work with product, engineering, and data teams to define AI/LLM use cases and share best practices.

What We’re Looking For:

• 5+ years of technical experience: 5+ years of experience as a Backend Software engineer working directly with ML and Gen-AI or similar. Prior startup experience is preferred but not required.

• Strong LLM & ML Expertise: Experience working with LLM technologies (AWS Bedrock, OpenAI, Anthropic, Hugging Face models, or Llama etc.) in production and proficiency with prompt engineering, model selection, and ML/AI observability.

• Technology Skills: Proficiency in Python, vector databases (FAISS, Pinecone, Weaviate), and retrieval-augmented generation (RAG) pipelines. Experience with Django, AWS/GCP, and pytest preferred but not required.

• MLOps Experience: Familiarity with AI model deployment, monitoring, and scaling in production environments.

• Problem-Solving Mindset: Ability to tackle ambiguous AI challenges and develop scalable, efficient AI solutions.

• Collaboration & Communication: Comfortable working with engineers, data scientists, and product teams to define and implement AI-driven features.

Our Tech Stack:

• Infra:AWS, Fargate, Redis, PostgreSQL, SQS, CDK, Github, retool

• Backend: Django REST framework, Celery

• Frontend: Next.js, Tailwind css

• LLM: AWS Bedrock, OpenAI, Claude