AI Expert/Architect

ReqRoute,Inc; New York (NY); Remote; USD 180,000 - 230,000; Full time

Job summary

ReqRoute,Inc is seeking an AI Expert/Architect to design enterprise-grade Generative AI apps that blend LLMs, retrieval, and orchestration. You will shape agentic systems with clear memory, state control, tool invocation, and robust production workflows.

You will lead architecture and mentoring across design, implementation, testing, and deployment, while advancing observability, prompt versioning, and safe production rollout in a remote setting.

Qualifications

• 18+ years of experience in large-scale distributed systems or enterprise apps.
• Proven track record shipping production AI/LLM-powered apps with agentic workflows.

Responsibilities

• Architect and build enterprise-grade Generative AI apps using LLMs, retrieval, data, orchestration, and workflow automation.
• Design agentic systems with LangGraph or equivalent; manage state, memory, tool invocation, human-in-the-loop checks.
• Build fault-tolerant orchestration for long-running AI workflows using Temporal or similar.
• Drive reference architectures for model routing, prompt versioning, observability, experimentation, and safe rollout.
• Establish evaluation frameworks with offline evals, tests, and trace diagnostics tied to business outcomes.
• Own full feature development across design, implementation, testing, shipping, and servicing.

Skills

Distributed systems

Generative AI

LLMs & Prompting

LangChain/LangGraph

Full-stack

Education

BS/MS/PhD CS/Engineering

Tools

LangChain

LangGraph

AutoGen

NodeJS

Job description

Job Description: AI Expert/Architect
Location: REMOTE

Top Skills Required

1. UI Architect (ReactJS)
2. Agentic AI (Lang graph , Lang chain)
3. NodeJS

Responsibilities

• Architect and build enterprise-grade Generative AI applications combining LLMs, retrieval, structured data, orchestration, and workflow automation.
• Design agentic systems and multi-step reasoning workflows using LangGraph or equivalent - with clear control over state, memory, tool invocation, and human-in-the-loop checkpoints.
• Build fault-tolerant orchestration for long-running AI workflows using Temporal or similar platforms.
• Drive reference architectures for model routing, prompt versioning, observability, experimentation, and safe production rollout.
• Establish LLM/agent evaluation frameworks - offline evals, regression suites, trace diagnostics, and quality metrics tied to business outcomes.
• Own full feature development across design, implementation, testing, shipping, and servicing.
• Write and review clean, high-quality code with a focus on performance, scalability, and maintainability.
• Set best practices for AI tooling, service observability, alerting, and incident response.
• Mentor engineers across the team and foster a culture of technical excellence and continuous learning.
• Use AI tools in your daily workflow and advocate evolving best practices to the broader team.

Required Qualifications

• 15+ years of experience building large-scale distributed systems, platforms, or enterprise applications.
• Proven track record shipping production AI/LLM-powered applications - agentic workflows, RAG systems, or intelligent automation.
• Deep expertise in Generative AI: LLMs (OpenAI), Prompt Engineering, RAG, vector search, and AI agent orchestration.
• Hands-on experience with agent frameworks: LangChain, LangGraph, AutoGen, or equivalent.
• Frontend and backend background to integrate AI solutions end-to-end into existing applications.
• Strong software engineering fundamentals: system design, algorithms, testing, debugging, and code review.
• Demonstrated ability to lead technical direction and mentor engineers.
• Comfort in ambiguous, fast-moving problem spaces where best practices are still emerging.
• BS, MS, or PhD in Computer Science, Engineering, or equivalent practical experience.