Multimodal AI Systems Architect (AI Engineering)

Hyphen Connect Limited; San Francisco (CA); On-site; USD 120,000 - 160,000; Full time

Job summary

Hyphen Connect Limited in San Francisco is seeking a Multimodal AI Systems Architect to develop and optimize AI systems that integrate vision and audio models. This role focuses on enhancing voice-to-voice interactions and multimodal retrieval capabilities, ensuring efficient and innovative systems.

The ideal candidate has experience with Whisper, CLIP, and multimodal LLM integration, as well as knowledge of streaming architectures and cross-modal alignment.

Qualifications

• Experience with Whisper, CLIP, and multimodal LLM integration.
• Knowledge of streaming architectures and WebRTC.
• Expertise in cross-modal alignment.

Responsibilities

• Integrate vision encoders and audio-native models into core agent reasoning loops.
• Optimize streaming latency for voice-to-voice AI interactions.
• Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.

Skills

Whisper

CLIP

multimodal LLM integration

streaming architectures

WebRTC

cross-modal alignment

Job description

We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models. This role focuses on enhancing our voice-to-voice interactions and multimodal retrieval capabilities, ensuring our systems are efficient and innovative.

Responsibilities

• Integrate vision encoders and audio-native models into core agent reasoning loops.
• Optimize streaming latency for voice-to-voice AI interactions.
• Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.

Qualifications

• Experience with Whisper, CLIP, and multimodal LLM integration.
• Knowledge of streaming architectures and WebRTC.
• Expertise in cross-modal alignment.