Agent Platform Engineer, Voice

Alldus; New York (NY); On-site; USD 160,000 - 210,000; Full time

Job summary

Alldus in New York City seeks an Agent Platform Engineer to lead production voice agents, delivering natural customer interactions and scalable tooling for the broader platform.

The ideal candidate has 2+ years of software engineering, experience with backend or real-time systems, and proficiency in TypeScript or Python; startup environment and cross‑team collaboration are essential.

Qualifications

• At least 2 years of experience in professional software engineering.
• Built and deployed backend, real-time or conversational systems in production.
• Proficient in TypeScript or Python.
• Strong knowledge of asynchronous processing and distributed systems.

Responsibilities

• Develop and maintain production voice agents handling customer interactions.
• Improve conversational performance: instruction adherence, turn-taking, pacing, and audio quality.
• Optimize latency across telephony, model processing and speech generation.
• Build and manage infrastructure for call routing, queues, recordings, and webhooks.
• Create reusable agent capabilities: memory, policies, tools, identity and actions.
• Integrate agents with scheduling, CRM and operational platforms.
• Develop automated evaluations, simulations and regression tests.
• Establish monitoring with traces, transcripts and alerts.
• Collaborate with product and customer teams to improve real conversations.
• Define architecture and roadmap for the unified agent platform.

Skills

TypeScript

Python

Backend systems

Real-time telephony

Distributed systems

Observability

Low latency optimization

Debugging

Ownership & proactive

Twilio familiarity

Tools

Twilio

SIP

Contact-centre infra

Job description

Our client, an early-stage AI Startup, is hiring an Agent Platform Engineer to join their team in New York City. The successful candidate will lead the development of production voice agents, create reliable, natural customer interactions and build shared tools, memory and infrastructure to support agents across the wider platform.

Responsibilities

• Develop and maintain production voice agents that handle inbound and outbound customer interactions.
• Refine conversational performance, including instruction adherence, turn-taking, interruptions, pacing, pronunciation and audio quality.
• Optimize response times across telephony, speech recognition, model processing, tool execution and speech generation while preserving accuracy and reliability.
• Build and manage infrastructure for call routing, queues, transfers, recordings, webhooks and failover.
• Create reusable agent capabilities for shared context, instructions, tools, memory, policies, identity and action execution.
• Connect agents with scheduling, diagnostic, CRM and operational platforms, ensuring reliable handling of retries, partial failures and ongoing workflows.
• Develop automated evaluations, simulations and regression tests to assess task completion, policy compliance, latency, audio quality and escalation to human teams.
• Establish monitoring and diagnostics using conversation traces, transcripts, audio events, failure analysis and alerts.
• Work closely with product and customer teams to assess real conversations, identify issues and implement improvements.
• Help define the architecture and development roadmap for the company's unified agent platform.

Skillset

• At least 2 years of experience in professional software engineering.
• A track record of building and deploying backend, real-time, telephony or conversational systems in production.
• Strong coding ability in TypeScript or Python.
• Sound knowledge of asynchronous processing, streaming, distributed systems and observability.
• The ability to balance low latency with reliable execution, instruction adherence and natural conversation.
• Confident debugging skills across application code, model responses, audio pipelines and customer configurations.
• An interest in developing reusable agent functionality that works across different channels.
• A proactive mindset, clear communication skills and the ability to take ownership in a fast-paced startup.
• Experience with Twilio, SIP or contact-centre infrastructure is desirable.
• Familiarity with LLM agents, streaming speech recognition, text-to-speech, real-time model APIs, evaluation frameworks or human handoff workflows.

Benefits

• Salary: $160k - $210k.