Multimodal ML Engineer: Sensing & Authentication

openai; United States; Hybrid; USD 150,000 - 210,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

OpenAI is seeking a machine learning engineer to help shape how future AI systems understand the physical world. You will work across multimodal perception and authentication, collaborating with hardware, firmware, software, and product teams to translate research into real-world systems.

San Francisco-based role with relocation assistance; three days in office per week, opportunity to work on cameras, microphones, and other sensors in dynamic environments.

Qualifications

• Strong background in computer vision, audio or speech ML, multimodal learning, or sensing.
• Experience building specialized ML models or larger multimodal models.
• Able to turn research ideas into prototypes or products.
• Familiar with sensing hardware or real-time deployment constraints.
• Proficient in Python and PyTorch; comfortable with C++.
• Experience with authentication or biometrics privacy applications.

Responsibilities

• Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
• Explore how specialized perception models and larger multimodal models can work together.
• Design data, training, and evaluation approaches that improve performance in real-world conditions.
• Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.
• Integrate and validate new capabilities in real-time or resource-constrained systems.
• Work with hardware, firmware, software, and product teams to turn research into working systems.

Skills

Computer vision

Audio/Speech ML

Multimodal learning

Sensing

Python

PyTorch

C++

Biometrics/privacy

Tools

C++

Systems integration

Job description

OpenAI is seeking a machine learning engineer to help shape how future AI systems understand the physical world. You will work across multimodal perception and authentication, collaborating with hardware, firmware, software, and product teams to translate research into real-world systems.

San Francisco-based role with relocation assistance; three days in office per week, opportunity to work on cameras, microphones, and other sensors in dynamic environments.