Staff Forward-Deployed AI Engineer for Enterprise

Cohere

San Francisco (CA)

Hybrid

USD 180,000 - 280,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

A weekly lunch stipend of $75/£75 or等
Full health and dental benefits
RRSP matching, 401K, Pension Scheme
Parental Leave top-up for 6 months
Annual enrichment benefits for arts,教育
6 weeks paid vacation
Travel budget to other offices + offst
Home office stipend $500

Job summary

Cohere is seeking a Staff Forward Deployed Engineer to architect high-performance, secure ML systems inside enterprise environments. You will bridge core engineering with strategic customers, owning inference challenges from multi-tenant serving to cross-datacenter resilience.

You will lead technical adoption, ensure low latency and high throughput, and drive platform upgrades based on field feedback while collaborating with client teams globally.

Qualifications

  • 8+ years of engineering experience in production infrastructure and large-scale distributed systems.
  • Deep Kubernetes expertise across multi-cluster and hybrid/multi-cloud ecosystems (GCP, Azure, AWS, OCI).
  • Strong understanding of LLM inference dynamics and performance.
  • Hands-on experience with inference engines and optimization stacks (vLLM, TensorRT-LLM, lmd, or Dynamo).
  • Familiarity with distributed serving techniques and multi-GPU workloads.
  • Exceptional customer-facing technical leadership with track record of guiding stakeholders.
  • Strong programming foundations in Python, Go, or C++, with capability to work across backend pipelines and infra.

Responsibilities

  • Embed with customer engineering teams to connect AI models with live production environments.
  • Design model serving topologies with multi-tenant architectures and cross-datacenter failover.
  • Optimize private deployments balancing Kubernetes multi-cluster scale with model performance.
  • Benchmark and profile LLM workloads; diagnose slow generation via metrics and logs.
  • Support Cohere models on next-gen accelerators (GPUs/TPUs/AMD/ASICs).
  • Translate field feedback into platform improvements and core product features.
  • Ensure Day-1 production reliability, establish deployment patterns, SLOs, and observability.

Skills

Production infra
Kubernetes multi-cluster
LLM architecture
Inference optimization
Distributed serving
Customer-facing leadership
Python/Go/C++

Tools

vLLM
TensorRT-LLM
LMD
Dynamo

Job description

Cohere is seeking a Staff Forward Deployed Engineer to architect high-performance, secure ML systems inside enterprise environments. You will bridge core engineering with strategic customers, owning inference challenges from multi-tenant serving to cross-datacenter resilience.

You will lead technical adoption, ensure low latency and high throughput, and drive platform upgrades based on field feedback while collaborating with client teams globally.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Staff Forward-Deployed AI Inference Engineer
Staff Forward-Deployed AI Inference Engineer

Cohere • United States

Hybrid
USD 180,000 - 260,000
Lunch stipend
Health and dental benefits
RRSP matching / 401K
+6
Senior Forward-Deployed AI Engineer for Enterprise
Senior Forward-Deployed AI Engineer for Enterprise

Anthropic Limited • San Francisco (CA)

Hybrid
USD 280,000 - 320,000
Staff Forward-Deployed AI Engineer (Hybrid, Client-Facing)
Staff Forward-Deployed AI Engineer (Hybrid, Client-Facing)

FDE Times • New York (NY), San Francisco (CA)

Hybrid
USD 210,000 - 300,000
Remote Forward-Deployed AI Engineer (Enterprise)
Remote Forward-Deployed AI Engineer (Enterprise)

Procore Technologies • Austin (TX)

Remote
USD 169,000 - 232,000
Equity compensation
Bonus incentive compensation
Senior AI Forward-Deployed Engineer for Enterprise
Senior AI Forward-Deployed Engineer for Enterprise

Alation, Inc. • United States

Remote
USD 152,000 - 205,000
Commuter benefits
Flexible time off
Health offerings
Senior Forward-Deployed AI Engineer (Enterprise)
Senior Forward-Deployed AI Engineer (Enterprise)

Anthropic Limited • New York (NY)

Hybrid
USD 280,000 - 320,000
Competitive compensation
Equity donation matching
Vacation & parental leave
+2
Staff Forward-Deployed AI Engineer for Enterprise
Staff Forward-Deployed AI Engineer for Enterprise

Snowflake Inc. • Menlo Park (CA)

On-site
USD 240,000 - 340,000
Staff Forward Deployed Engineer - AI for Enterprise Remote
Staff Forward Deployed Engineer - AI for Enterprise Remote

Alation, Inc. • United States

Remote
USD 125,000 - 168,000
Commuter benefits
Health offerings
Flexible time off
Staff Forward-Deployed AI Engineer - Enterprise Programs Lead
Staff Forward-Deployed AI Engineer - Enterprise Programs Lead

Snowflake • Menlo Park (CA)

On-site
USD 200,000 - 288,000
Medical insurance
Dental insurance
Vision insurance
+2
Staff Enterprise AI Architect — Forward Deployed
Staff Enterprise AI Architect — Forward Deployed

Meta • New York (NY)

On-site
USD 184,000 - 257,000
Bonus
Equity
Benefits