Multimodal Perception & Authentication ML Engineer

Triwill Group; San Francisco, Northern (CA, KY); Hybrid; USD 150,000 - 200,000; Full time

Benefits offered by this job

Relocation assistance

Job summary

OpenAI in San Francisco is seeking a machine learning engineer to shape how future AI systems understand the physical world and people within it. You will work on multimodal perception and authentication, integrating signals from cameras, microphones, and other sensors.

You will collaborate with hardware, firmware, software, and product teams to bring research into real-world systems, with relocation assistance offered and a hybrid work model (office three days per week in SF).

Qualifications

• Background in computer vision, audio or speech ML, multimodal learning, or sensing.
• Experience developing specialized ML models or larger multimodal models.
• Experience bringing research ideas into practical prototypes or products.
• Proficient in Python and PyTorch; comfortable with C++ or systems integration.
• Experience with authentication, biometrics, or privacy-sensitive applications.
• Ability to design experiments and evaluate model behavior.

Responsibilities

• Research and develop multimodal perception and authentication methods across visual, audio, and other sensing signals.
• Explore integration of specialized perception models and larger multimodal models.
• Design data, training, and evaluation approaches that work in real-world conditions.
• Study model behavior, robustness, and failure modes across sensing and deployment environments.
• Integrate and validate new capabilities in real-time or resource-constrained systems.
• Collaborate with hardware, firmware, software, and product teams to ship research into working systems.

Skills

Python

PyTorch

C++

Computer vision

Multimodal learning

Speech/Audio ML

Systems integration

Authentication/ biometrics

Job description

OpenAI in San Francisco is seeking a machine learning engineer to shape how future AI systems understand the physical world and people within it. You will work on multimodal perception and authentication, integrating signals from cameras, microphones, and other sensors.

You will collaborate with hardware, firmware, software, and product teams to bring research into real-world systems, with relocation assistance offered and a hybrid work model (office three days per week in SF).