Senior ML Inference Engineer — Model Efficiency

Cohere; Montreal; Remote; CAD 100,000 - 130,000; Full time

Benefits offered by this job

Open and inclusive culture

Cutting-edge AI research collaboration

Weekly lunch stipend

Full health and dental benefits

Parental Leave top-up for 6 months

Personal enrichment benefits

Remote-flexible work options

6 weeks of vacation

Job summary

A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time.

Qualifications

• 5+ years of experience writing high-performance, production-quality code.
• Strong programming skills in C++ or Python (Rust/Go also welcome).
• Experience with large language models and the LLM inference ecosystem.
• Ability to diagnose and resolve performance bottlenecks.
• A strong bias for action — you ship fast, measure impact, and iterate.

Responsibilities

• Work across the inference stack to improve core performance metrics.
• Identify bottlenecks and develop innovative optimizations.
• Collaborate closely with modeling and systems teams.
• Experiment, measure, and ship improvements to accelerate inference.

Skills

High-performance code

C++ programming

Python programming

Diagnosing performance bottlenecks

Proactive action and iteration

Job description

A leading AI technology company is seeking a Member of Technical Staff to enhance model efficiency. This role involves improving performance metrics, optimizing bottlenecks, and collaborating with various teams. The ideal candidate has 5+ years in high-performance coding, strong skills in C++ or Python, and familiarity with large language models. Competitive perks include a flexible work environment, health benefits, and generous vacation time.