Research Engineer: Autonomous Speech AI & LLM Research

Commotion; New York (NY); Híbrido; USD 125 000 - 190 000; Tempo integral

Resumo da oferta

Commotion is seeking an AI/ML Engineer (Research) in New York to push the boundaries of speech-driven AI. You will work on LLM-backed speech systems, focusing on direct speech-to-speech modelling, VAD, and expressive speech synthesis within an autonomous research framework.

You will collaborate with the Research Director to shape long-term roadmaps, explore ART and memory-augmented architectures, and contribute to SOTA multimodal research.

Qualificações

• 2+ years of applied or academic experience in speech, multimodal, or LLM research.
• Bachelor's or Master's in Computer Science, AI, or a related field.
• Strong in Python and scientific computing; experience in JupyterHub environments.

Responsabilidades

• Research and develop direct speech-to-speech modelling pipelines leveraging LLM backbones and audio encoders/decoders.
• Model and evaluate turn-taking, latency handling, and voice activity detection (VAD) for real-time conversational AI.
• Explore Agentic Reinforcement Training (ART) and self-learning loops for continual improvement.

Conhecimentos

LLM research

Speech research

Python programming

Experiment design

Formação académica

Bachelor's or Master's in CS/AI

Ferramentas

PyTorch

HuggingFace

LangChain

Descrição da oferta de emprego

Commotion is seeking an AI/ML Engineer (Research) in New York to push the boundaries of speech-driven AI. You will work on LLM-backed speech systems, focusing on direct speech-to-speech modelling, VAD, and expressive speech synthesis within an autonomous research framework.

You will collaborate with the Research Director to shape long-term roadmaps, explore ART and memory-augmented architectures, and contribute to SOTA multimodal research.