Full-Time Engineer: AI Software Engineer

OpenInfer

San Francisco (CA)

Sur place

USD 140 000 - 200 000

Plein temps

14 jours+

Une candidature complète en une minute

Un CV et une lettre de motivation personnalisés, prêts à envoyer.

Passez les filtres ATS

Avantages offerts par ce poste

Medical, Dental, and Vision benefits
Flexible Paid Time Off, 10 days
Parental Leave
401(k) Plan with company matching
Snacks and coffee

Résumé du poste

OpenInfer in the Bay Area is hiring a Full-Time Engineer: AI Software Engineer to contribute to a Rust-based local AI inference engine and the API front-end. You will help deploy across Windows, Linux, MacOS, Android, and iOS while joining a collaborative team developing high-performance AI software.

You’ll work on the customer-facing codebase powering our improvements in LLM inference, integrate with React Native, Java/Kotlin, Swift, C/C++, and Python, and participate in building robust CI/CD

Qualifications

  • 1–3 years of Rust experience (personal projects, coursework, or work).
  • Proficiency in async Rust and concurrent programming.
  • Strong generalist with a growth mindset.
  • Strong problem-solving and attention to detail.
  • Nice to have: Axum, Actix or other Rust web frameworks.
  • Familiarity with Docker and cloud services.
  • Familiarity with GitHub Actions and CI/CD.
  • 3 years experience in C++.
  • Experience with Android NDK and integrating Rust into mobile apps.
  • Working with LLMs and local inference engines.
  • Familiarity with REST design and FFI into C, Python, etc.

Responsabilités

  • Develop and maintain LLM inference engine written in Rust.
  • Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS).
  • Maintain GitHub actions to build & release software.
  • Maintain end-to-end integrations with Rust across major customer development platforms (React Native, Java/Kotlin, Swift, C/C++, Python).
  • Debug and troubleshoot issues in our API and related infrastructure.
  • Collaborate with product and AI teams to integrate new features.

Connaissances

Rust development
Async programming
Problem solving
Learning agility
Cross-functional collaboration

Outils

Axum
Actix
Docker
GitHub Actions
CI/CD
llama.cpp
Ollama
Android NDK
REST/FFI
C++

Description du poste

Full-Time Engineer: AI Software Engineer

Bay Area, CA

Full-time

Position Overview

We are looking for a Rust Software Developer to join our team and work on cutting-edge local AI inference. This role is ideal for someone eager to grow their Rust development skills while contributing to our API front-end and core systems. You will be contributing to the customer-facing codebase that is the vehicle for us delivering our improvements to LLM inference. If you’re excited about Rust and AI, we’d love to hear from you!

Key Responsibilities
  • Develop and maintain LLM inference engine written in Rust
  • Deploy Rust to all major client platforms (Windows, Linux, MacOS, Android, iOS)
  • Maintain GitHub actions to build & release software
  • Maintain end-to-end integrations with Rust across major customer development platforms (React.Native, Java/Kotlin, Swift, C/C++, Python)
  • Debug and troubleshoot issues in our API and related infrastructure
  • Collaborate with product and AI teams to integrate new features
Required Qualifications
  • Ideally at least 1-3 years of experience with Rust (personal projects, coursework, or previous work).
  • Proficiency in async Rust and concurrent programming
  • Strong generalist comfortable with learning and growth attained by tackling out-of-expertise problems.
  • Strong problem-solving skills and attention to detail
  • Nice to have Qualifications
  • Familiarity with Axum, Actix, or other Rust web frameworks
  • Understanding of containerization (Docker) and cloud services
  • Familiarity with GitHub Actions and CI/CD
  • 3 years experience in C++
  • Experience with Android NDK and integrating Rust into mobile applications
  • Working with LLMs and local inference engines like llama.cpp or Ollama
  • Familiarity with REST design and FFI integration into C, Python, etc
What You'll Gain
  • Opportunity to work alongside industry experts in AI optimization, high-performance computing, and hardware acceleration.
  • Hands-on experience with cutting-edge technologies at the intersection of AI and hardware acceleration.
  • Exposure to open-source development and collaboration with a vibrant community.
  • Extensive experience building and maintaining a Rust codebase
Benefits We Offer
  • At OpenInfer we offer comprehensive benefits, some include:
  • Medical, Dental, and Vision benefits
  • Flexible Paid Time Off, 10 days
  • Parental Leave
  • 401(k) Plan with company matching
  • Snacks and coffee to keep you energized

These benefits are further detailed in OpenInfer policies and are subject to change at any time, consistent with the terms of any applicable compensation or benefits plans.

Obtenez votre examen gratuit et confidentiel de votre CV.

ou faites glisser et déposez votre fichier ici.

Similar jobs

Postes similaires à comparer

Rust AI Software Engineer - Local Inference & Growth
Rust AI Software Engineer - Local Inference & Growth

OpenInfer • San Francisco (CA)

Sur place
USD 140 000 - 200 000
Medical, Dental, and Vision benefits
Flexible Paid Time Off, 10 days
Parental Leave
+2
Data Infrastructure Engineer (Rust) - High Performance Computing
Data Infrastructure Engineer (Rust) - High Performance Computing

Alignerr • États-Unis

À distance
USD 83 000 - 131 000
Back-end Engineer
Back-end Engineer

Sterling Inspired Staffing. • New York (NY)

Sur place
USD 180 000 - 260 000
Rapid personal growth
Collaborative in-person environment
Opportunity to work on open-source projects
+1
Member of Technical Staff (AI Inference Engineer)
Member of Technical Staff (AI Inference Engineer)

Kindredventures • Palo Alto (CA)

Hybride
USD 190 000 - 250 000
Comprehensive health insurance
Dental insurance
Vision insurance
+1
Software Engineer - Full Stack San Francisco
Software Engineer - Full Stack San Francisco

FriendliAI Inc. • San Francisco (CA)

Sur place
USD 180 000 - 230 000
Flexible hours
Lunch/dinner provided
Unlimited snacks
+4
Rust Developer
Rust Developer

Alignerr • États-Unis

À distance
USD 83 000 - 152 000
Backend & Tooling Engineer (Rust)
Backend & Tooling Engineer (Rust)

Alignerr • États-Unis

À distance
USD 83 000 - 165 000
Software Engineer, Developer Productivity - Inference Runtime
Software Engineer, Developer Productivity - Inference Runtime

OpenAI, Inc. • San Francisco (CA)

Sur place
USD 230 000 - 385 000
Principal Rust Engineer - ML Infrastructure
Principal Rust Engineer - ML Infrastructure

Alignerr • États-Unis

À distance
USD 165 000 - 317 000
Member of Technical Staff, Forward Deployed Engineer
Member of Technical Staff, Forward Deployed Engineer

Inferact • San Francisco (CA)

À distance
USD 200 000 - 400 000
Visa sponsorship available
Health, dental, vision benefits
401(k) company match