Staff AI Architect – Real-Time Conversation Intelligence (NY)

Xenoss; Northern, New York (KY, NY); Hybrid; USD 150,000 - 190,000; Full time

Job summary

Xenoss in New York is seeking a Staff AI Engineer/AI Architect to lead the architecture of a real-time conversation intelligence system for a major financial services client. You will guide data taxonomy, model training, evaluation, and production readiness across the In-Call Assistant lifecycle.

You will own end-to-end design, collaborate with AI engineers, data teams, MLOps, and client SMEs, and balance accuracy, latency, and governance while delivering PoC-to-production solutions with strong

Qualifications

• Must have hands-on production AI/ML experience.
• Experience with NLP, conversational AI, or transcript-based intelligence systems.
• Ability to design evaluation frameworks, not just run experiments.
• Experience building or validating structured datasets from unstructured text.
• Strong understanding of LLM-based extraction, classification, RAG, and fine-tuning trade-offs.
• Practical knowledge of classical ML or predictive modeling.
• Understanding of probability-based prediction, calibration, and outcome evaluation.
• Comfort working with messy enterprise data and incomplete labels.
• Ability to communicate with both technical teams and business stakeholders.
• Strong ownership of ambiguity, scope control, and PoC validation strategy.

Responsibilities

• Design end-to-end AI architecture for the In-Call Assistant.
• Define signal and trigger taxonomies for live conversations.
• Design training strategies for signal detection and specialist recommendation models.
• Shaping data preparation, annotation, and SME validation workflows.
• Evaluating fine-tuning, post-training, RAG, and hybrid approaches.
• Designing low-latency signal detection, routing, context preparation, and confidence management.
• Defining grounding, guardrails, abstention, and policy-compliance behavior.
• Making trade-offs between model quality, latency, cost, explainability, and governance.
• Partnering with AI engineers, data engineering, MLOps, and client SMEs.

Skills

Applied AI/ML systems

NLP/Conversational AI

Evaluation frameworks

Structured datasets from unstructured

LLM extraction & classification

Model governance

Low-latency inference

Stakeholder communication

Ambiguity management

Tools

PyTorch

Hugging Face

Job description

Xenoss in New York is seeking a Staff AI Engineer/AI Architect to lead the architecture of a real-time conversation intelligence system for a major financial services client. You will guide data taxonomy, model training, evaluation, and production readiness across the In-Call Assistant lifecycle.

You will own end-to-end design, collaborate with AI engineers, data teams, MLOps, and client SMEs, and balance accuracy, latency, and governance while delivering PoC-to-production solutions with strong