Agentic AI Architect

Visa Hunt; United States; On-site; USD 180,000 - 240,000; Full time

Job summary

Visa Hunt is seeking a hands-on architect with 10-15+ years in software, data and AI engineering, and 4-6+ years in AI/ML/GenAI architecture, to craft an enterprise-scale platform. The role focuses on agentic AI-enabled systems, governance, and ModelOps across data, AI, and integration layers.

Ideal candidates have strong distributed systems experience and a track record delivering scalable, secure solutions in enterprise settings.

Qualifications

• 10–15+ years in software/data/AI engineering.
• 4–6+ years in AI/ML/GenAI architecture.
• Experience designing enterprise-scale platforms for distributed systems.

Responsibilities

• Define end-to-end integration architecture across platform and APIs.
• Perform hands-on development and lead technical execution across AI, data, and platform teams.
• Guide engineers and ensure alignment with architecture and governance.

Skills

AI architecture

Distributed systems

Platform design

Cross-functional leadership

Education

Bachelor's or Master's in Computer Science/Engineering/Data Science

Tools

Azure OpenAI

LangGraph

Semantic Kernel

Azure AI Search

NVIDIA NeMo Guardrails

Microsoft Presidio

Azure DevOps

GitHub Actions

App Insights

Job description

Role & Responsibilities Overview:

Platform & Integration Design

• Define integration architecture across - Lakehouse, ODS, document systems; Underwriting systems and third-party APIs
• Design configurable, metadata-driven framework for multi-LOB onboarding
• Define API/microservices patterns (Python/.NET hybrid)

Technical Development, Execution

• Perform hands on development and lead technical execution across AI, data, and platform teams
• Guide engineers (AI, data, full-stack) and ensure alignment with architecture
• Drive technical decisions and stakeholder communication

Governance, Safety & ModelOps

• Define AI safety and guardrails (PII, hallucination control, policy constraints)
• Establish ModelOps and PromptOps frameworks
• Ensure explainability, auditability, and traceability of AI outputs

Architecture & Technical Leadership

• Define end-to-end architecture for agentic AI-enabled platform across data, AI, orchestration, and integration layers
• Design and govern agentic orchestration framework for multi-step workflows
• Establish architecture patterns for - RAG and grounding, Vector search and retrieval, MCP tool access layer, prompt management and evaluation

AI & GenAI Enablement

• Define where and how to use - GenAI vs deterministic logic, agentic workflows vs pipeline workflows
• Establish multimodal integration approach combining structured, unstructured, and external data
• Design prompt lifecycle, evaluation, and optimization strategy

Candidate Profile:

• Experience: 10-15+ years in software/data/AI engineering with 4-6+ years in AI/ML/GenAI architecture
• Background: Strong experience in designing enterprise-scale platforms and distributed systems
• Domain (good to have): Insurance / reinsurance / financial services
• Education: Bachelor's or Master's in Computer Science, Engineering, Data Science, or related field
• Profile Type: Hands-on architect with ability to balance strategy + execution

Technical skills:

• GenAI & Agentic Frameworks - Semantic Kernel/ LangGraph (or similar orchestration frameworks); LLM integration (Azure OpenAI, OpenAI APIs, etc.); Prompt engineering, prompt lifecycle design
• Retrieval & RAG - Azure AI Search (indexing, vector search, hybrid search); Embedding pipelines and retrieval optimization; RAG design, grounding strategies, context management
• Tool Access & Integration - MCP (Model Context Protocol) architecture and tool design; API design (FastAPI / REST / microservices); Integration with enterprise systems and third-party APIs
• AI Safety & Governance - NVIDIA NeMo Guardrails;Microsoft Presidio (PII detection/masking); Guardrails for prompt injection, hallucination control
• Evaluation & ModelOps - Azure AI Foundry (model hosting, versioning, monitoring); Evaluation frameworks (LLM-as-judge, test datasets); Prompt/version control, cost/latency monitoring
• DevOps & Observability - CI/CD pipelines (Azure DevOps / GitHub Actions); Logging, monitoring, observability (App Insights, etc.); Performance tuning and scalability

Originally posted on Himalayas