Forward-Deployed AI Interview Architect

Take2; United States; Hybrid; USD 140,000 - 210,000; Full time

Job summary

Take2 AI is hiring a Forward Deployed Engineer to design, launch, and continuously improve our AI Interviewers for enterprise customers. You’ll shape voice agent prompts, flows, and evaluation rubrics, deploying production interviewers and iterating rapidly from customer feedback and metrics.

This hands-on, highly analytical role blends data-driven decision making with customer-facing delivery, in a startup-friendly environment with a focus on scale and reliability.

Qualifications

• Minimum 2 (preferred 4-6) years of experience working in an engineering role.
• 1+ (preferred 2+) years working with LLMs, NLP systems, or AI agents in production.
• Strong full-stack software engineering experience.
• Demonstrated experience designing and deploying agent workflows (prompts + structured flows) that operate at scale.
• Strong understanding of prompt engineering, agent control, failure modes, and conversational edge cases.
• Experience building or contributing to evaluation/testing/QA frameworks for AI systems.
• Comfort being customer-facing: running technical discovery, translating requirements, and driving onboarding to production.
• Strong analytical mindset (accuracy, consistency, bias, calibration, and edge cases).

Responsibilities

• Lead technical onboarding with customers to understand roles, hiring goals, must-have signals, and constraints.
• Translate customer needs into structured interview flows, role-specific question banks, and scoring rubrics.
• Set clear expectations on what “good” looks like (pass/fail thresholds, evaluation rationale, interviewer tone and style).
• Design, build, and refine prompts and agent logic that drive interviewer behavior, question sequencing, probing, and candidate experience.
• Ensure interviewer conversations are consistent, role-relevant, and robust to edge cases (evasive candidates, unclear answers, noisy audio, interruptions).
• Implement multi-step structured interview flows with state management and guardrails.
• Design and maintain AI-based evaluation and scoring aligned to customer rubrics and hiring criteria.
• Improve accuracy, consistency, and explainability of scoring at scale (including calibration across roles/customers).
• Identify bias/fairness risks and contribute to mitigation strategies and compliant evaluation practices.
• Launch new customer interviewers into production and own iteration cycles from early rollout through steady-state performance.
• Use customer feedback + production metrics to prioritize improvements and deliver measurable outcomes.
• Communicate changes clearly to customers and internal stakeholders.
• Build and own lightweight QA/evaluation pipelines to measure conversation quality, scoring accuracy, and reliability before/after changes.
• Monitor production performance and balance quality, latency, and cost tradeoffs.
• Contribute to standards and best practices for prompt quality, eval quality, and voice-agent reliability.

Skills

Full-stack software engineering

Python

LLMs/NLP in production

Customer-facing

Education

Bachelor's degree in CS/Engineering/Math or related field

Tools

LLMs: GPT, Claude, Gemini, LLaMA

APIs & Data pipelines

Job description

Take2 AI is hiring a Forward Deployed Engineer to design, launch, and continuously improve our AI Interviewers for enterprise customers. You’ll shape voice agent prompts, flows, and evaluation rubrics, deploying production interviewers and iterating rapidly from customer feedback and metrics.

This hands-on, highly analytical role blends data-driven decision making with customer-facing delivery, in a startup-friendly environment with a focus on scale and reliability.