Multimodal ML Engineer: Perception & Authentication

Slope; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

OpenAI is seeking a machine learning engineer to shape how future AI systems understand the physical world and people within it. The role focuses on multimodal perception and authentication, combining signals from cameras, microphones, and other sensors to build reliable real-world systems.

You'll work with specialized perception models and larger multimodal models, partnering with hardware, firmware, software, and product teams to transition research into usable products.

Qualifications

• Background in computer vision, audio or speech ML, multimodal learning or sensing.
• Experience building specialized ML models or larger multimodal models.
• Applied research ideas to prototypes or products in real systems.

Responsibilities

• Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
• Explore how specialized perception models and larger multimodal models can work together.
• Design data, training, and evaluation approaches that improve real-world performance.
• Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.
• Integrate and validate new capabilities in real-time or resource-constrained systems.
• Collaborate with hardware, firmware, software, and product teams to turn research into working systems.

Skills

Computer vision

Multimodal learning

Audio / speech ML

Python

PyTorch

C++

Systems integration

Authentication / biometrics

Job description

OpenAI is seeking a machine learning engineer to shape how future AI systems understand the physical world and people within it. The role focuses on multimodal perception and authentication, combining signals from cameras, microphones, and other sensors to build reliable real-world systems.

You'll work with specialized perception models and larger multimodal models, partnering with hardware, firmware, software, and product teams to transition research into usable products.