Senior Software Developer, AI Agents

Knak; Ottawa; On-site; CAD 120,000 - 180,000; Full time

Benefits offered by this job

Equity

Great benefits

Paid vacation

Job summary

Knak is seeking a Senior Software Developer, AI Agents, to build and scale the AI agents behind its marketing platform. You will design the agent harness, orchestration, and evaluation pipelines that ensure high-quality outputs for marketing assets.

You will contribute to architecture decisions, mentor teammates, and collaborate with engineering, product, and DevOps to shape the future of marketing automation.

Qualifications

• 6+ years of backend software development experience.
• Hands-on experience building LLM-powered agents in production, including tool calling, orchestration, context management, and prompt engineering.
• Experience designing and running evaluations for LLM systems, including dataset curation, automated evaluators, LLM-as-judge, and regression tracking.
• Strong proficiency in Python, Node.js, and MySQL.
• Expertise in RESTful APIs, TDD, CI/CD (GitHub Actions).
• Experience with SaaS architecture, microservices, and AWS.
• Knowledge of observability, performance tuning, and scalability.
• Familiarity with Docker/Kubernetes.

Responsibilities

• Build the agent harness: design and implement the core agent runtime in Python, including orchestration loops and memory management.
• Own agent evaluations: develop eval datasets and automated evaluators for changes.
• Iterate on agent quality: diagnose failures and tune prompts and tool designs.
• Create AI microservices: develop Python and Node.js services for hosting and LLM interaction.
• Build reliable APIs: maintain Laravel PHP APIs that integrate agents into Knak platform.
• Deploy to the cloud: use AWS services to build scalable infrastructure.
• Optimize databases: tune MySQL queries for speed.
• Elevate code quality: lead code reviews and maintain standards.
• Collaborate across teams: align with product, design, QA, and DevOps.
• Mentor engineers: share knowledge on agent development and evaluation.

Skills

Backend development

LLM agents in production

Tool calling

Orchestration

Context management

Prompt engineering

LLM Evaluations

Python

RESTful APIs

AWS

Docker

Kubernetes

Tools

Node.js

MySQL

Laravel (PHP) APIs

Docker

Kubernetes

GitHub Actions

AWS

Job description

Knak Is a Mission-driven Company Why? Because our time is limited, our competition is fierce, and our margin for error is small. For us to have the greatest impact on the world, we need to be laser focused on our core mission, which is...

Knak Is a Mission-driven Company Why? Because our time is limited, our competition is fierce, and our margin for error is small. For us to have the greatest impact on the world, we need to be laser focused on our core mission, which is... Empowering people to be creative. That's why Knak exists. We are a world-class enterprise email and landing page creation platform with a focus on making successful and happy customers by providing them with an incredibly powerful, yet easy to use creation platform. Our industry leading SaaS solution is built by Marketers, for Marketers. We know that it's the small things that make the biggest impact and that emails and landing pages are where the rubber hits the road when it comes to Marketing Automation. We change the way Marketers work by making them more efficient, while improving conversion rate of their campaigns and helping them stay on brand. Oh, and we have a bit of fun while doing it, too!

The Role: Senior Software Developer, AI Agents

We're looking for an experienced software developer to build and scale the AI agents behind Knak's platform. In this role you'll develop the agent harness itself: the orchestration, tool calling, context management, and guardrails that let agents analyze data, generate complex marketing assets, and deliver real value to our customers. You'll also ensure we know they work, by building the evaluation suites that measure agent quality and catch regressions before they reach customers. This is a hands-on role for someone who wants to be deep in agent internals every day. You'll also contribute to architecture decisions, mentor teammates, and collaborate across engineering and product to shape the future of marketing automation.

What You'll Be Doing

• Build the agent harness: Design and implement the core agent runtime in Python: orchestration loops, tool definitions and execution, memory and context management, structured outputs, and failure handling.
• Own agent evaluations: Build and maintain eval datasets, automated evaluators, and LLM-as-judge pipelines (LangSmith) so every prompt, model, or harness change is measured, not guessed at.
• Iterate on agent quality: Diagnose agent failures from traces, tune prompts and tool designs, and run model comparisons and benchmarks to drive measurable improvements.
• Create AI microservices: Build Python and Node.js services for agent hosting and LLM interaction.
• Build reliable APIs: Develop and maintain the Laravel (PHP) APIs that integrate agents into the Knak platform, ensuring testability, observability, and performance.
• Deploy to the cloud: Use AWS services (Lambda, Bedrock, CDN delivery) to build secure, scalable infrastructure for agents.
• Optimize databases: Tune MySQL queries and indexing to improve speed and reduce latency.
• Elevate code quality: Lead and participate in code reviews, maintaining high standards across the team.
• Collaborate cross-functionally: Work with product, design, QA, and DevOps to align solutions with business needs.
• Mentor engineers: Share knowledge on agent development and evaluation practices, and set a high bar for technical excellence.

What You Should Bring

• 6+ years of backend software development experience
• Hands-on experience building LLM-powered agents in production, including tool calling, orchestration, context management, and prompt engineering
• Experience designing and running evaluations for LLM systems, including dataset curation, automated evaluators, LLM-as-judge, and regression tracking
• Strong proficiency in Python, Node.js, and MySQL
• Expertise in RESTful APIs, TDD, CI/CD (GitHub Actions)
• Experience with SaaS architecture, microservices, and AWS
• Knowledge of observability, performance tuning, and scalability
• Familiarity with Docker/Kubernetes
• Excellent problem-solving skills and a collaborative mindset

Nice to Have

• Interest in, or experience with, full-stack web development spanning frontend (e.g. Vue), backend (e.g. PHP Laravel), and agent engineering, with a willingness to work across all three as the product needs
• Experience in AI-powered product development
• Background with LLMs, LangGraph, or AI agent frameworks
• Prior experience in a fast-growing SaaS company

What We Offer

At Knak we have four foundational pillars. Culture, customers, product and growth. Culture is our number one pillar because we know that is at the core of building a strong company that can build amazing products and delight our customers. We do this with a laser focus on hiring the right people who are smart, positive and who want more than the typical nine-to-five offers. We offer an extremely rewarding, second to none work environment as acknowledged by Ottawa’s Best Places to Work 2025! We show our investment in our people through our competitive salaries, equity in the company, great benefits, paid vacation, Life leave days (because life happens), team lunches and off-sites, and most importantly our commitment to YOUR career growth.

If you don't see yourself fully reflected in every job requirement listed on the posting above, we still encourage you to reach out and apply. Research has shown that women and underrepresented groups often only apply when they feel 100% qualified. We strongly encourage applicants of all genders, ages, ethnicities, cultures, abilities, sexual orientations, and life experiences to apply. Knak believes in creating an inclusive, barrier-free working environment. If you require ANY accommodation to the interview process please contact [e-mail].

At Knak, our recruitment process includes AI screening for keywords and minimum qualifications as well as video interviews which are transcribed with AI. Humans are still at the core of our decision making! Please note that this job post is for an existing vacancy.