Senior ML Platform Backend Engineer

Coveo; Montreal (administrative region); On-site; CAD 110,000 - 150,000; Full time

Job summary

Coveo in Montreal, Canada is seeking a Backend Developer to help build scalable AI-powered search and inference services. You will contribute to the development lifecycle, implement reliable backend systems in a cloud environment, and collaborate with scientists, data engineers and developers to deploy agentic workflows.

Ideal candidates have 5+ years in backend development, strong knowledge of distributed systems, and comfort with learning new tools and best practices.

Qualifications

• 5+ years of backend development in a cloud environment with Python or Java/Spring.
• Solid understanding of distributed systems and scalable design.
• Strong problem-solving and debugging skills with guidance when needed.
• Comfortable learning new tools, technologies, and best practices.

Responsibilities

• Contribute to the development lifecycle, including coding, testing and deployment.
• Analyze and improve observability, reliability, and usability of backend services.
• Maintain services handling millions of requests and LLM calls daily.
• Collaborate with data scientists, data engineers, and developers to productionize agentic apps.
• Help evolve the platform to support growth of agentic workflows for Coveo users.
• Suggest process improvements and leverage AI coding tools to aid development.

Skills

Backend development

Distributed systems

Debugging

Cloud environments

Python

Java/Spring

AWS

Tools

Terraform

AWS Bedrock

OpenSearch

Vector databases

LLM inference gateways

Job description

Coveo in Montreal, Canada is seeking a Backend Developer to help build scalable AI-powered search and inference services. You will contribute to the development lifecycle, implement reliable backend systems in a cloud environment, and collaborate with scientists, data engineers and developers to deploy agentic workflows.

Ideal candidates have 5+ years in backend development, strong knowledge of distributed systems, and comfort with learning new tools and best practices.