AI Inference API Engineering Lead

Mistral

New York (NY)

On-site

USD 180,000 - 240,000

Full time

6 days ago
Be an early applicant

Get more replies from employers

Send a job-specific resume in minutes.

Benefits offered by this job

Healthcare coverage
Relocation support
Wellness programs

Job summary

Mistral is seeking an experienced Engineering Lead to join our Inference API team. You will lead a new team focused on evolving our inference stack, shipping enterprise-level features, and aligning API formats.

You’ll scale the team, set priorities, and foster a healthy engineering culture while collaborating with Product and Design to deliver end-to-end solutions that empower customers worldwide. This is a high-visibility role with the opportunity to shape how Mistral's technology is adopted

Qualifications

  • Experience building and managing engineering teams.
  • Proficiency in Python and at least one web framework (FastAPI, Django, Flask).
  • Proficiency in C#, Golang, TypeScript and at least one web framework.
  • Experience with large-scale distributed systems.
  • Experience working with cross-functional teams, such as Product, Design, and Business.
  • Knowledge of databases, caching mechanisms, and messaging systems.
  • Strong problem-solving abilities and attention to detail.
  • Ownership mindset and ability to ship products end-to-end.
  • Excellent communication skills and a low-ego, team-first attitude.

Responsibilities

  • Remove obstacles and create an environment where your team can focus on building solutions.
  • Translate product vision into technical reality, collaborating closely with the Product team.
  • Ensure applications are performant, stable, and responsive.
  • Uphold high code quality standards through reviews, testing, and automation.
  • Own the full software development process, from design to deployment.
  • Plan projects, including roadmaps, deadlines, and task allocation.
  • Collaborate with stakeholders across Engineering, Product, and Design.
  • Support team growth through hiring, onboarding, and mentorship.

Skills

Engineering leadership
Python
FastAPI
Django
Flask
C#
Golang
TypeScript
Distributed systems
Cross-functional collaboration

Job description

Mistral is seeking an experienced Engineering Lead to join our Inference API team. You will lead a new team focused on evolving our inference stack, shipping enterprise-level features, and aligning API formats.

You’ll scale the team, set priorities, and foster a healthy engineering culture while collaborating with Product and Design to deliver end-to-end solutions that empower customers worldwide. This is a high-visibility role with the opportunity to shape how Mistral's technology is adopted

Get your free, confidential resume review.
or drag and drop your file here.
Similar jobs

Similar jobs worth comparing

Inference API Engineering Lead
Inference API Engineering Lead

Socket.dev • New York (NY)

On-site
USD 180,000 - 240,000
Healthcare coverage
Relocation support
Retirement plans
+2
Engineering Lead, Inference
Engineering Lead, Inference

Mistral • New York (NY)

On-site
USD 180,000 - 250,000
Healthcare coverage
Relocation support
Flexible work options
Engineering Manager, Inference
Engineering Manager, Inference

Mistral • New York (NY)

On-site
USD 180,000 - 240,000
Healthcare coverage
Relocation support
Wellness programs
Engineering Manager, Inference
Engineering Manager, Inference

Socket.dev • New York (NY)

On-site
USD 180,000 - 240,000
Healthcare coverage
Relocation support
Retirement plans
+2
Senior Applied AI Tech Lead — Enterprise Solutions
Senior Applied AI Tech Lead — Enterprise Solutions

Mistral AI • New York (NY)

On-site
USD 200,000 - 260,000
Healthcare coverage
Relocation support
Applied AI, Forward Deployed Machine Learning Engineer
Applied AI, Forward Deployed Machine Learning Engineer

Mistral • San Francisco (CA)

On-site
USD 140,000 - 190,000
Technical Program Manager, AI Data & Annotation Ops
Technical Program Manager, AI Data & Annotation Ops

Headline - Asia • Palo Alto (CA)

On-site
USD 140,000 - 190,000
Healthcare coverage
Relocation support
Retirement plans
+1
Senior AI/ML Platform Engineering Manager (Inference)
Senior AI/ML Platform Engineering Manager (Inference)

CoreWeave • New York (NY)

On-site
USD 188,000 - 303,000
Medical, dental, and vision insurance
Company-paid Life Insurance
401(k) with generous match
+3
Strategic AI Deployment & Adoption
Strategic AI Deployment & Adoption

Mistral • Palo Alto (CA)

On-site
USD 100,000 - 140,000
Competitive salary and equity
Healthcare: Medical/Dental/Vision
Pension: 401K (6% matching)
+6
Technical Program Manager — AI Data & Annotation Lead
Technical Program Manager — AI Data & Annotation Lead

Mistral • Palo Alto (CA)

On-site
USD 140,000 - 190,000