Senior Gen AI Architect - Remote, Enterprise Impact

KLDiscovery; McLean (VA); On-site; USD 190,000 - 230,000; Full time

Job summary

KLDiscovery is seeking a senior AI Architect to own the generative AI and ML engineering north star. You will design and ship end-to-end AI architecture across Nebula and Operations, personally building core components, agent loops, and evaluation harnesses for enterprise-scale data.

You will lead AI engineering, deploy models, monitor drift and latency, and collaborate with product and data science leaders to drive defensible AI in court-ready workflows.

Qualifications

• 7+ years in machine learning, applied AI, or ML engineering with senior/principal-level experience.
• Proven track record architecting and personally building enterprise gen AI systems in production.
• Builder at heart: still writes code, ships, and tunes prompts and evals as a leader.
• Deep expertise across the gen AI stack: LLMs, agents, RAG, embeddings, search, evaluation harnesses.
• Hands-on experience designing system-of-systems AI pipelines spanning search, retrieval, agent harnesses, and model triage.
• Strong proficiency with the Microsoft AI stack: Azure OpenAI, Azure AI Foundry, Azure AI Search.
• Experience owning MLOps and AI telemetry: deployment, eval pipelines, monitoring, drift detection, prompts/agent observability.
• Excellent technical leadership; ability to influence architecture decisions across product and engineering.
• Strong communication skills to explain AI architecture trade-offs to executives and customers.

Responsibilities

• Own the AI-native architecture across Nebula and CS & Operations, including LLMs, agent harnesses, RAG, vector search, and embeddings.
• Build and ship the hardest parts personally: prototype agent loops, tune retrieval, design evaluation harnesses, and shared AI infrastructure.
• Lead architecture for AI Case Explorer, AI Agent Review, and CS & OPS tech-enablement using AI as a core orchestration component.
• Own AI/MLOps and AI telemetry end-to-end: deployment/versioning, eval pipelines, drift/quality monitoring, cost and latency telemetry.
• Set the technical bar by building, not by reviewing; mentor senior ICs and represent KLDiscovery's AI strategy with customers and at events.

Skills

Gen AI architecture

Hands-on ML

MLOps & telemetry

Azure OpenAI

Production systems

Technical leadership

Communication skills

7+ years experience

Education

MS or PhD in CS/ML

Tools

Azure OpenAI

Azure AI Foundry

Azure AI Search

Vector databases

Job description

KLDiscovery is seeking a senior AI Architect to own the generative AI and ML engineering north star. You will design and ship end-to-end AI architecture across Nebula and Operations, personally building core components, agent loops, and evaluation harnesses for enterprise-scale data.

You will lead AI engineering, deploy models, monitor drift and latency, and collaborate with product and data science leaders to drive defensible AI in court-ready workflows.