Senior Technical Program Manager, Machine Learning Infrastructure

Role Hound

Canada

Hybrid

CAD 120,000 - 180,000

Full time

6 days ago
Be an early applicant
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Lunch stipend
Healthcare
Pension & 401K
Parental Leave
Enrichment stipend
Paid vacation
Office travel budget
Home office stipend

Job summary

Cohere is seeking a Machine Learning Technical Program Manager to help scale our Generative Modeling efforts. You will partner with AI researchers and cross-functional teams to deliver strategic initiatives with precision and impact.

In this role you will own program delivery, navigate uncertain space, and drive engineering execution while aligning with senior leadership on long-term goals. Remote-friendly with global teams.

Qualifications

  • 5-10 years as a Technical Program Manager and 5+ years on AI/ML (foundation models preferred).
  • Deep knowledge of ML, NLP & LLMs; bonus for multimodal AI.
  • Experience in chaotic, fast-paced, low-structure environments; pragmatic and hands-on.

Responsibilities

  • Establish and scale foundational processes for Generative Modeling teams.
  • Scale the operational capacity of the Modeling TPM team as portfolio grows.
  • Adapt to company needs, spanning long-term programs to short-term challenges.
  • Partner with leaders to design, train and improve core generative models.
  • Lead cross-functional programs with Product, Engineering, Legal, Platform, Infra, Policy and Finance.
  • Improve engineering execution rigor and contribute to long-term planning with senior leadership.
  • Map dependencies and risks; communicate status to stakeholders.

Skills

Technical Program Manager
AI/ML experience
NLP & LLMs
Multimodal AI
Fast-paced environment
Business acumen
Hands-on ML

Job description

Who are we?

Cohere is the leading security-first enterprise AI company. We build cutting-edge foundation AI models and end-to-end products that are designed to solve real-world business problems.

We’re training and deploying frontier models for enterprises who are building AI systems. We believe that our work is instrumental to the widespread adoption of AI and we are looking for folks that want to be part of that.

We obsess over what we build. Each one of us is responsible for contributing to increasing the capabilities of our models and the value they drive for our customers. Cohere is a team of researchers, engineers, designers, and more, who are all passionate about their craft.

We are a global technology company headquartered in Toronto with key offices in London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul. Join us!

Why the Cohere TPM role?

As our Generative Machine Learning organization has continued growing, we are looking for more Technical Program Managers to join the team!

At Cohere, TPMs are pivotal to our success, being seen as operational experts specializing in cross-functional efforts. Great TPMs at Cohere are well-rounded, executing with precision at the tactical level, while partnering with senior leaders and shaping the big picture at a strategic level, and the opportunities are endless in growing the scale and impact of their work. Cohere’s TPMs would often be described as organized, execution-oriented, pragmatic leaders who are adaptable to the needs of the company and the programs they lead.

As a reward for the depth and breadth of expertize that you bring to the table, you will get to work alongside some of the most talented AI researchers and industry experts in the world on building cutting edge AI technology. No day will be the same as the one before, and the dynamic high growth environment will be absolutely perfect for anyone excited about solving novel problems, bringing structure to oftentimes chaotic and fast-paced environments, and ambitious about scaling their own impact and growth alongside the company!

Please note: While we are remote-first and accept candidates from all over the world, we are highly prioritizing hiring for people who are within 1-2 hours of British Standard Time (BST).

As a Machine Learning Technical Program Manager, you will:
  • Establish, improve, and scale foundational processes that allow the Generative Modeling teams to execute better, faster, and more predictably

  • Scale the operational capacity and effectiveness of the Modeling TPM team in collaboration with the Modeling TPM lead to ensure the function can remain lean and effective during a period of the program portfolio complexity and size continuing to rapidly increase

  • Flexibly adapt to the needs of the company, programs, and the team from tackling long-horizon programs that can span quarters or even years to jumping onto often highly ambiguous short-term challenges that can have company-wide impact

  • Partner directly with leaders within and outside of the Modeling organization on efforts to design, train and improve our core generative models

  • Lead cross-functional, oftentimes company-wide programs and strategic initiatives, collaborating and coordinating with cross-functional teams such as Product, Engineering, Legal, Platform, Infra, Policy, and Finance

  • Operate as an organizational expert in improving engineering execution rigor and operations on the ground, while contributing to the strategic layer in areas such as long-term strategic planning with senior modeling leadership

  • Map out dependencies and risks, and ensure that cross-functional execution across the program runs smoothly, communicating status with non-technical and technical stakeholders and senior management

  • Both own and enable a useful communication flow of priorities, ideas, and knowledge throughout and beyond the Modeling organization in line with your programs

  • Respond quickly to program-level changes, clarifying new scope, and managing resource needs in response to evolving priorities

You may be a good fit if you have:
  • 5-10 years as a Technical Program Manager AND 5+ years of experience working directly on AI/ML. Strong preference for candidates that have worked directly in building foundation models.

  • In-depth knowledge of machine learning, particularly when it comes to Natural Language Processing & Large Language Models (LLMs). Bonus points for experience with Multimodal AI.

  • Experience with working in a chaotic, fast paced, low structure environment. We need someone who is pragmatic, can roll up their sleeves when needed, and can function at the tactical and strategic level to do whatever it takes to make Cohere’s models succeed

  • Personal hands-on understanding of the unique challenges of managing projects and programs in the AI/ML development space as opposed to traditional software program management

  • Managed projects & programs requiring a strong general business acumen, such as coordinating with Finance on reporting needs or Policy on regulatory compliance matters — the broader your experience beyond ML technical program management, the better!

  • (optional, but preferred) Have technical experience in a hands-on capacity. We don’t necessarily need someone with hands on experience training models, but you need to feel comfortable sitting in the same rooms with some of the best researchers in the world, working on highly complex, cutting edge ML problems

If some of the above - other than the ML TPM experience - doesn’t line up perfectly with your experience, we still encourage you to apply! If you consider yourself a thoughtful worker, a lifelong learner, and a kind and playful team member, Cohere is the place for you.

We welcome applicants of all kinds and are committed to providing both an equal opportunity process and work environment. We value and celebrate diversity and strive to create an inclusive work environment for all.

Full-Time Employees at Cohere enjoy these Perks:
  • A weekly lunch stipend of $75/£75 or equivalent in your local currency for lunch.

  • Full health and dental benefits, including a separate budget for mental health.

  • RRSP matching, 401K, Pension Scheme.

  • 100% Parental Leave top-up for up to 6 months, for either parent.

  • Annual enrichment benefits:

    Arts & culture, fitness/wellness, quality time, and a workspace improvement credit.

    Education & learning stipend for conferences, courses, and coaching.

  • 6 weeks of paid vacation (30 working days!)

  • Budget for traveling to other offices if you are remote, plus an annual company offsite.

How and Where We Work:
  • Cohere is remote-friendly, but we also have offices in Toronto, London, New York City, San Francisco, Montreal, Paris, Berlin and Seoul with more opening soon.

  • For those in the office: a daily lunch program, plenty of snacks, and regular community and social events.

  • For those not near an office: a co-working benefit so you can work alongside others in your city.

  • Everyone receives a $500 home office stipend to set up your workspace properly.

If any of the above doesn’t line up exactly with your experience, we still encourage you to apply.


We strive to create an inclusive work environment for all; we welcome applicants from all backgrounds and are committed to providing equal opportunities. Should you require any accommodations during the recruitment process, please submit an Accommodations Request Form, and we will work together to meet your needs.

We may use AI-enabled tools to screen and assess applicants against the criteria for this position. This helps our recruiters identify potentially qualified candidates, but it doesn't limit the applications our recruiters may review or consider.

Beware of Scams: Cohere will never ask for payment or third-party services (e.g., CV writing) as part of our hiring process. All legitimate roles are listed on the Cohere careers page and LinkedIn only, with all communications from Cohere employees coming from an @cohere.com or @cw.cohere email alias. If jobs are viewed on other sites then please verify these through our official careers page.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Member of Technical Staff, Agentic Environments
Member of Technical Staff, Agentic Environments

Cohere • Toronto

On-site
GBP 90,000 - 150,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+5
Member of Technical Staff, Agentic Environments
Member of Technical Staff, Agentic Environments

Jaide Health • Toronto

On-site
CAD 140,000 - 210,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Senior Member of Technical Staff, Synthetic Data
Senior Member of Technical Staff, Synthetic Data

Cohere Inc. • Toronto

Remote
CAD 140,000 - 190,000
Weekly lunch stipend
Full health and dental benefits
RRSP matching / 401K
+4
Member of Technical Staff, Modeling
Member of Technical Staff, Modeling

Cohere • Toronto

On-site
CAD 150,000 - 190,000
Lunch stipend
Health and dental benefits
RRSP matching
+4
Lead Member of Technical Staff, Inference Infrastructure
Lead Member of Technical Staff, Inference Infrastructure

Kibbi • Toronto

Hybrid
CAD 335,000 - 463,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / Pension
+5
Senior Member of Technical Staff, Safety and Security for Agents
Senior Member of Technical Staff, Safety and Security for Agents

Jaide Health • Toronto

On-site
CAD 180,000 - 240,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+9
Senior Member of Technical Staff, Multimodal AI
Senior Member of Technical Staff, Multimodal AI

Kibbi • Toronto

Remote
CAD 250,000 - 535,000
Weekly lunch stipend
Health and dental benefits
RRSP matching / 401K / Pension
+4
Senior Research Scientist, Model Evaluation
Senior Research Scientist, Model Evaluation

Cohere Inc. • Toronto

Remote
CAD 130,000 - 170,000
Lunch stipend
Health and dental benefits
RRSP matching
+5
Staff Software Engineer, Inference Infrastructure
Staff Software Engineer, Inference Infrastructure

Cohere • Toronto

On-site
CAD 140,000 - 200,000
Weekly lunch stipend
Health and dental benefits
RRSP matching
+4
Member of Technical Staff, Integration/RL Team (Research Engineer)
Member of Technical Staff, Integration/RL Team (Research Engineer)

Cohere • Toronto

On-site
CAD 140,000 - 210,000
Weekly lunch stipend
Health & dental benefits
RRSP matching
+5