Multimodal AI Systems Architect (AI Engineering)

Hyphen Connect Limited; Boston (MA); On-site; USD 130,000 - 160,000; Full time

Job summary

Hyphen Connect Limited is seeking a talented Multimodal AI Systems Architect based in Boston, USA. The successful candidate will develop and optimize innovative AI systems that integrate both vision and audio models, focusing on enhancing voice-to-voice interactions.

This role requires expertise in multimodal systems, and the ability to architect solutions that efficiently retrieve insights from diverse media formats like videos and PDFs. Join a team that values cutting-edge technology and innovation.

Qualifications

• Experience with multimodal LLM integration.
• Proficient in using WebRTC.
• Strong understanding of streaming technologies.

Responsibilities

• Integrate vision encoders and audio-native models into core agent reasoning loops.
• Optimize streaming latency for voice-to-voice AI interactions.
• Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.

Skills

Experience with Whisper

Knowledge of streaming architectures

Expertise in cross-modal alignment

Job description

Boston, USA

We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models. This role focuses on enhancing our voice-to-voice interactions and multimodal retrieval capabilities, ensuring our systems are efficient and innovative.

Responsibilities

• Integrate vision encoders and audio-native models into core agent reasoning loops.
• Optimize streaming latency for voice-to-voice AI interactions.
• Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.

Qualifications

• Experience with Whisper, CLIP, and multimodal LLM integration.
• Knowledge of streaming architectures and WebRTC.
• Expertise in cross-modal alignment.