AI Inference API Engineering Lead

Mistral

New York (NY)

On-site

USD 180,000 - 240,000

Full time

14 days+
Application generator

Don’t send a generic resume — generate a resume and cover letter tailored to this exact role.

Get past ATS filters

Benefits offered by this job

Healthcare coverage
Relocation support
Wellness programs

Job summary

Mistral is seeking an experienced Engineering Lead to join our Inference API team. You will lead a new team focused on evolving our inference stack, shipping enterprise-level features, and aligning API formats.

You’ll scale the team, set priorities, and foster a healthy engineering culture while collaborating with Product and Design to deliver end-to-end solutions that empower customers worldwide. This is a high-visibility role with the opportunity to shape how Mistral's technology is adopted

Qualifications

  • Experience building and managing engineering teams.
  • Proficiency in Python and at least one web framework (FastAPI, Django, Flask).
  • Proficiency in C#, Golang, TypeScript and at least one web framework.
  • Experience with large-scale distributed systems.
  • Experience working with cross-functional teams, such as Product, Design, and Business.
  • Knowledge of databases, caching mechanisms, and messaging systems.
  • Strong problem-solving abilities and attention to detail.
  • Ownership mindset and ability to ship products end-to-end.
  • Excellent communication skills and a low-ego, team-first attitude.

Responsibilities

  • Remove obstacles and create an environment where your team can focus on building solutions.
  • Translate product vision into technical reality, collaborating closely with the Product team.
  • Ensure applications are performant, stable, and responsive.
  • Uphold high code quality standards through reviews, testing, and automation.
  • Own the full software development process, from design to deployment.
  • Plan projects, including roadmaps, deadlines, and task allocation.
  • Collaborate with stakeholders across Engineering, Product, and Design.
  • Support team growth through hiring, onboarding, and mentorship.

Skills

Engineering leadership
Python
FastAPI
Django
Flask
C#
Golang
TypeScript
Distributed systems
Cross-functional collaboration

Job description

Mistral is seeking an experienced Engineering Lead to join our Inference API team. You will lead a new team focused on evolving our inference stack, shipping enterprise-level features, and aligning API formats.

You’ll scale the team, set priorities, and foster a healthy engineering culture while collaborating with Product and Design to deliver end-to-end solutions that empower customers worldwide. This is a high-visibility role with the opportunity to shape how Mistral's technology is adopted

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Engineering Manager, Inference
Engineering Manager, Inference

Mistral • New York (NY)

On-site
USD 180,000 - 240,000
Healthcare coverage
Relocation support
Wellness programs
Senior Applied AI Tech Lead — Enterprise Solutions
Senior Applied AI Tech Lead — Enterprise Solutions

Mistral AI • New York (NY)

On-site
USD 200,000 - 260,000
Healthcare coverage
Relocation support
Senior AI Infrastructure Team Lead
Senior AI Infrastructure Team Lead

United States Digital Space LLC • Paris (TX)

On-site
USD 180,000 - 240,000
Healthcare coverage
Retirement plans
Relocation support
+3
Full-Stack AI Research Engineer
Full-Stack AI Research Engineer

Mistral • Palo Alto (CA)

On-site
USD 140,000 - 210,000
Healthcare coverage
Parental leave
Retirement plans
+4
Senior AI Research & Engineering Recruiter
Senior AI Research & Engineering Recruiter

UNKNOWN • Palo Alto (CA)

On-site
USD 120,000 - 180,000
Head of Partnership Engineering
Head of Partnership Engineering

Mistral • New York (NY), Northern (KY)

Hybrid
USD 180,000 - 260,000
Healthcare coverage
Parental leave
Relocation support
+2
Engineering Manager: Inference Infrastructure Leader
Engineering Manager: Inference Infrastructure Leader

EngineersOfAI • New York (NY), Northern (KY)

Hybrid
USD 230,000 - 360,000
Tech Talent Acquisition Lead - AI Research & Engineering
Tech Talent Acquisition Lead - AI Research & Engineering

Mistral • Palo Alto (CA)

On-site
USD 150,000 - 210,000
Sovereign AI Infrastructure Engineer
Sovereign AI Infrastructure Engineer

Mistral-Ai • Palo Alto (CA)

On-site
USD 150,000 - 190,000
Healthcare benefits
Parental leave
Relocation support
+2
Applied AI, Forward Deployed Machine Learning Engineer
Applied AI, Forward Deployed Machine Learning Engineer

Mistral • San Francisco (CA)

On-site
USD 140,000 - 190,000