Founding AI Engineer: Real-Time Testing for Voice Agents

Aimhire; San Francisco (CA); On-site; USD 150,000 - 230,000; Full time

Job summary

Aimhire is recruiting a Founding AI Engineer to work with the founders on the core AI infrastructure powering their voice agent testing and monitoring platform. You will drive experimentation, build scalable systems, and interface directly with customers to incorporate feedback and improve performance.

This hands-on, high-impact role lets you help define product and technology direction from day one, shaping how the platform evaluates and ensures reliability of conversational AI in real-world

Qualifications

• 1+ years of experience as an AI or ML Engineer.
• Strong proficiency in Python.
• Experience working with LLMs or conversational AI systems.
• Familiarity with evaluation pipelines and production deployment.

Responsibilities

• Build AI tools for testing, benchmarking, and monitoring conversational agents
• Develop scalable pipelines and evaluation methods for LLMs
• Implement systems for real-time monitoring and feedback
• Optimize deployments for high availability and performance
• Engage with customers to understand needs and shape product direction
• Continuously experiment and improve AI reliability and accuracy

Skills

Python

LLMs / Conversational AI

Production deployment

Job description

Aimhire is recruiting a Founding AI Engineer to work with the founders on the core AI infrastructure powering their voice agent testing and monitoring platform. You will drive experimentation, build scalable systems, and interface directly with customers to incorporate feedback and improve performance.

This hands-on, high-impact role lets you help define product and technology direction from day one, shaping how the platform evaluates and ensures reliability of conversational AI in real-world