Senior Developer - Machine Learning Platform

Coveo; Montreal; On-site; CAD 80,000 - 120,000; Full time

Job summary

Join a forward-thinking company as a Senior Developer on the Machine Learning team, where you'll enhance a mission-critical platform that trains thousands of models and serves over 100 million queries daily. This role offers you the chance to innovate in AI by optimizing deployment processes and ensuring high availability of services. Collaborate with a talented team to push the boundaries of machine learning capabilities and make a significant impact in the tech landscape. If you're passionate about backend development and eager to tackle complex challenges, this opportunity is perfect for you.

Qualifications

• 5+ years of backend development experience, preferably in Java/Spring.
• Strong understanding of scalable and resilient distributed systems.

Responsibilities

• Contribute to the development lifecycle from design to deployment.
• Design scalable solutions and improve platform performance.

Skills

Backend Development

Cloud Environment

Problem Solving

Distributed Systems

Tools

Java

Spring

AWS

Terraform

Kubernetes

Job description

Streamline the deployment of Machine Learning models

As a Senior Developer on the Machine Learning team, you’ll play a key role in supporting other ML teams with the deployment and integration of ML models, including Large Language Models (LLMs), into existing infrastructure. Our team has built a mission-critical platform that trains thousands of models and serves over 100M model queries daily. This is your chance to accelerate AI innovation at Coveo by enhancing our ML platform’s capabilities to safely deploy, serve, and test models at scale.

As part of this team, you will develop, optimize and implement automated processes that facilitate model deployment, while ensuring scalability, reliability and performance. Are you driven by the challenge of expanding the capabilities of our machine learning platform? Then this is the opportunity for you!

Here’s what you’ll be responsible for:

• Contribute to every stage of the development lifecycle, from design and coding to automated testing and deployment.
• Design and implement scalable solutions to enhance operational efficiency and streamline automated deployments.
• Investigate and improve the performance, scalability, and efficiency of our platform infrastructure.
• Ensure high availability and reliability of services handling millions of requests per day.
• Contribute to the architecture and evolution of our platform by bringing forward innovative ideas.
• Collaborate with applied scientists, data engineers, and software developers to integrate models seamlessly into the existing infrastructure.

Here is what will qualify you for the role:

• 5+ years of experience in backend development in a cloud environment (Java/Spring preferred, AWS an asset).
• Strong understanding of building scalable and resilient distributed systems, with experience producing reusable code within complex infrastructures for large-scale applications.
• A problem-solving mindset, with the resourcefulness to analyze, optimize, and debug large-scale systems while continuously embracing a growth-oriented approach.

Here is what would make you stand out:

• Familiarity with Terraform & Kubernetes for infrastructure automation and container orchestration.
• Experience with open-source ML serving frameworks.

Do you think you can bring this role to life? Send us your application, we want to get to know you!

Apply for this job

First Name *

Last Name *

Email *

Phone *

Location *

Resume *

Are you currently legally allowed to work in Canada? *

I am currently located in the following province: *

If you're not located in the province where the job is advertised, are you willing to relocate? *

How many years of experience relevant to this role do you estimate you have? *

What is the range of your salary expectations? *

In what language do you want us to communicate with you?

Is there a preferred pronoun we should use? (optional)

For more information regarding how we use your personal information as part of the recruitment process, please read our Applicant and Candidate Privacy Notice.

Thank You!

We appreciate your interest in Coveo. We will be in touch with you shortly.