Multimodal AI Systems Architect (AI Engineering)

Hyphen Connect Limited; Oregon (WI); On-site; USD 110,000 - 150,000; Full time

Job summary

Hyphen Connect Limited is seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models.

The ideal candidate will integrate vision encoders and audio-native models into reasoning loops, architect multimodal systems for insights retrieval from diverse formats, and optimize latency for voice interactions.

Qualifications

• Experience with integrating vision and audio AI models.
• Strong understanding of streaming architectures.
• Proficient in cross-modal AI alignment techniques.

Responsibilities

• Integrate vision encoders and audio-native models into core agent reasoning loops.
• Optimize streaming latency for voice-to-voice AI interactions.
• Architect multimodal RAG systems for insights retrieval.

Skills

Multimodal LLM integration

Streaming architectures

Cross-modal alignment

Tools

Whisper

CLIP

WebRTC

Job description

We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI systems that seamlessly integrate vision and audio models.

Responsibilities

• Integrate vision encoders and audio-native models into core agent reasoning loops.
• Optimize streaming latency for voice-to-voice AI interactions.
• Architect multimodal RAG systems capable of retrieving insights from videos and PDFs.

Qualifications

• Experience with Whisper, CLIP, and multimodal LLM integration.
• Knowledge of streaming architectures and WebRTC.
• Expertise in cross‑modal alignment.