AI Voice Agent Engineer — Build Real-Time Conversational AI

Socket.dev; New York (NY); On-site; USD 150,000 - 250,000; Full time

Job summary

CollectWise is hiring an AI Agent Engineer to design voice AI infrastructure, real-time agent systems, and prompting strategies. You will own end-to-end prompts, test frameworks, and continuous improvement based on performance and feedback.

You will work across product and operations to align technical work with business outcomes, delivering scalable voice interactions for millions of users.

Qualifications

• 2+ years of experience in voice AI, conversational AI, prompt engineering, speech systems, or related agentic workflows.
• 3+ years of experience in platform, infrastructure, or backend engineering.
• Strong experience with Node.js, AWS, and SQL.
• Experience building and shipping production systems in a startup or similarly fast-paced environment.
• Experience with voice orchestration platforms or agent frameworks such as LiveKit.
• Strong prompt writing instincts and the ability to design clear, effective, and resilient conversational flows.
• Strong analytical skills and comfort tying technical work directly to business outcomes and ROI.
• Excellent communication skills, high ownership, and a strong work ethic.

Responsibilities

• Build our voice AI infrastructure in LiveKit.
• Design and own the architecture of our real-time voice agent systems, including orchestration, state management, latency optimization, prompting and reliability.
• Own the end-to-end prompting strategy for CollectWise voice agents, including conversation flows, tone, compliance-safe phrasing, guardrails, and edge-case handling.
• Build and maintain testing and evaluation frameworks for voice agent performance, including A/B testing, regression testing, conversation QA, benchmarking, and KPI reporting.
• Write, expand, and improve our core AI prompting to cover more real-world scenarios.
• Continuously iterate based on performance data, call outcomes, and customer feedback to improve containment, conversion, liquidation rates, and customer satisfaction.
• Optimize ASR, STT, TTS, turn-taking, interruption handling, and state transitions to improve voice quality and agent performance.
• Build scalable systems and tooling to support millions of voice interactions.
• Migrate client implementations from legacy voice AI infrastructure to the latest systems you build, while preserving client-specific customizations and workflows.
• Develop prompt and agent tooling, including versioning, rollout strategies, monitoring, safety checks, and debugging workflows.
• Work closely with product, operations, and leadership to translate business goals into high-performing voice agent behavior.

Skills

Voice AI

Conversational AI

Prompt engineering

Node.js

AWS

SQL

Tools

LiveKit

Job description

CollectWise is hiring an AI Agent Engineer to design voice AI infrastructure, real-time agent systems, and prompting strategies. You will own end-to-end prompts, test frameworks, and continuous improvement based on performance and feedback.

You will work across product and operations to align technical work with business outcomes, delivering scalable voice interactions for millions of users.