Founding ML Inference Engineer — Ultra-Low Latency AI

Reactor; San Francisco (CA); Sur place; USD 180 000 - 280 000; Plein temps

Avantages offerts par ce poste

Competitive salary

Early equity

Health, dental, and vision coverage

Relocation support

Résumé du poste

A media technology company in San Francisco is seeking a Founding Engineer specializing in ML Inference. This highly technical role requires expertise in the ML infrastructure stack and aims to optimize generative media performance. The ideal candidate will drive innovations in real-time model performance, design in-house inference runtimes, and optimize models through advanced techniques. Competitive salary and relocation support are offered, along with generous health coverage.

Qualifications

• Strong foundation in systems programming with a track record of identifying and resolving bottlenecks.
• Deep expertise in ML infrastructure stack, including PyTorch, TensorRT, and more.
• Knowledge of model compilation and quantization techniques.

Responsabilités

• Drive performance for real-time model performance for diffusion models.
• Design a high-performance in-house inference runtime.
• Optimize models for inference through quantization and pruning.
• Benchmark model performance to identify bottlenecks.

Connaissances

Systems programming

PyTorch

TensorRT

Model compilation

Quantization

NVIDIA GPU hardware knowledge

Transformer architectures

Description du poste

A media technology company in San Francisco is seeking a Founding Engineer specializing in ML Inference. This highly technical role requires expertise in the ML infrastructure stack and aims to optimize generative media performance. The ideal candidate will drive innovations in real-time model performance, design in-house inference runtimes, and optimize models through advanced techniques. Competitive salary and relocation support are offered, along with generous health coverage.