Multimodal Perception ML Engineer for Authentication

OpenAI; San Francisco (CA); Hybrid; USD 342,000 - 399,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

OpenAI in San Francisco is seeking a machine learning engineer to help shape how future AI systems understand the physical world, focusing on multimodal perception and authentication.

You will work with specialized perception models and larger multimodal models, and partner with hardware, firmware, software, and product teams to bring new research into real-world systems.

We encourage collaboration across disciplines and offer relocation assistance for this role in a hybrid, SF-based setting.

Qualifications

• Experience in computer vision, audio or speech ML, multimodal learning, or sensing.
• Experience developing specialized ML models or multimodal models, or both.
• Experience bringing research ideas into practical systems, prototypes, or products.
• Know how to design experiments, build evaluations, and investigate model behavior.
• Experience with sensing hardware, real-time systems, or other deployment constraints.
• Proficiency in Python and PyTorch; comfortable with C++ or systems integration.
• Experience with authentication, biometrics, or other privacy-sensitive applications.
• Enjoy working across disciplines on research problems that are still taking shape.

Responsibilities

• Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
• Explore how specialized perception models and larger multimodal models can work together.
• Design data, training, and evaluation approaches that improve performance in real-world conditions.
• Study model behavior, robustness, and failure modes across sensing, data, and deployment environments.
• Integrate and validate new capabilities in real-time or resource-constrained systems.
• Work with hardware, firmware, software, and product teams to turn research into working systems.

Skills

Computer vision

Multimodal learning

Python

PyTorch

C++

Biometrics

Privacy

System integration

Tools

PyTorch

C++

Job description

OpenAI in San Francisco is seeking a machine learning engineer to help shape how future AI systems understand the physical world, focusing on multimodal perception and authentication.

You will work with specialized perception models and larger multimodal models, and partner with hardware, firmware, software, and product teams to bring new research into real-world systems.

We encourage collaboration across disciplines and offer relocation assistance for this role in a hybrid, SF-based setting.