Inference Systems Engineer, High-Throughput AI Serving

Future Ventures; Palo Alto (CA); On-site; USD 135,000 - 160,000; Full time

Benefits offered by this job

Comprehensive medical, vision, dental coverage

401(k) retirement plan

Paid parental leave

Paid vacation and holidays

Job summary

Future Ventures in Palo Alto is seeking an Application Software Engineer to develop scalable AI inference systems. The successful candidate will be responsible for architecture and optimization of distributed systems, working to deliver reliable performance.

A Bachelor's degree in computer science or similar, alongside proficiency in Rust or C++, is required. The position emphasizes problem-solving and teamwork within a fast-paced environment.

Qualifications

• 2+ years of professional experience building software.
• Experience in implementing scalable distributed systems.
• 1+ years of experience with production systems.

Responsibilities

• Develop high-throughput inference systems.
• Architect scalable distributed infrastructure.
• Optimize model inference for low latency.

Skills

Distributed systems design

Full stack development

Rust programming

C++ programming

Education

Bachelor's degree in computer science or related field

Tools

Docker

Kubernetes

PostgreSQL

MongoDB

Job description

Future Ventures in Palo Alto is seeking an Application Software Engineer to develop scalable AI inference systems. The successful candidate will be responsible for architecture and optimization of distributed systems, working to deliver reliable performance.

A Bachelor's degree in computer science or similar, alongside proficiency in Rust or C++, is required. The position emphasizes problem-solving and teamwork within a fast-paced environment.