AI Solutions Architect

Impiricus; United States; Remote; USD 165,000 - 210,000; Full time

Benefits offered by this job

Medical, dental, vision coverage

オン-demand healthcare concierge

401(k) with company match

Remote-first with in-person collab

Job summary

Hidden Jobs is seeking an AI Solutions Architect to turn grassroots AI prototypes into secure, scalable internal apps. You will bridge non-technical business teams with a central AI hub, designing workflows through applied LLM engineering.

The role supports Atlanta, New York, or fully remote work across the U.S., with a base salary range and strong benefits. You will own uptime, drift management, and governance for deployed solutions.

Qualifications

• 5+ years in product or product design with measurable impact or 2+ years in software/engineering shipping prod apps.
• Hands-on with LLM orchestration frameworks (LangChain/LlamaIndex), prompt engineering and retrieval-augmented generation.
• Strong Python, RESTful APIs and cloud deployment of internal apps.
• Experience partnering with non-technical leaders to translate problems into requirements.

Responsibilities

• Audit and evaluate AI tools and automations for ROI, security posture and fit.
• Refactor prototypes into enterprise-grade applications.
• Design LLM orchestration integrations with data lake and Salesforce CRM.
• Own graduated internal AI apps, including uptime and drift management.
• Translate ambiguous problems into scoped technical solutions with stakeholders.
• Apply data governance to prevent leakage and reduce hallucinations.

Skills

LLM orchestration

Prompt engineering

Retrieval-Augmented Generation

Python

REST APIs

Cloud deployment

Stakeholder collaboration

Tools

LangChain

LlamaIndex

Job description

Role overview

A forward-deployed AI Solutions Architect role focused on turning grassroots AI prototypes built inside business units into secure, scalable, production-grade internal applications. The position bridges non-technical commercial teams and a central AI hub, redesigning internal workflows through applied LLM engineering. Work can be based in Atlanta, New York, or fully remote across the U.S.

Responsibilities

• Audit and evaluate "vibe-coded" AI tools and automations built by business units, assessing ROI, security posture, and architectural fit
• Refactor high-value prototypes (for example, AI sales assistants or RFP generators) into enterprise-grade applications
• Design and maintain LLM orchestration integrations with internal systems, including a data lake and Salesforce CRM
• Take full ownership of graduated internal AI applications, including uptime, prompt-drift management, and schema updates
• Translate ambiguous operational problems into scoped technical solutions while managing stakeholder expectations
• Apply data governance standards to prevent leakage, control access, and reduce hallucination risk

Requirements

• Either 5+ years in product or product design with measurable impact and hands-on AI prototyping, or 2+ years in software/data engineering or technical architecture shipping production applications
• Hands-on production experience with LLM orchestration frameworks (such as LangChain or LlamaIndex), prompt engineering, and retrieval-augmented generation
• Strong Python skills; deep experience with RESTful APIs and modern cloud deployment of internal apps
• Track record of partnering with non-technical business leaders to convert open-ended problems into precise requirements

Nice to have

• Experience acting as your own product manager, including stakeholder interviews and roadmap ownership
• Entrepreneurial background
• A strong GitHub portfolio of shipped operational tools

Benefits and work setup

• Base salary range of $165,000-$210,000, depending on skills, experience, and location
• Medical, dental, and vision coverage with an on-demand healthcare concierge
• HSA, FSA, and dependent-care pre-tax accounts with employer HSA contributions
• 100% employer-paid short- and long-term disability, plus life and AD&D insurance
• Flexible time off and paid parental leave (after six months)
• 401(k) with company match
• Remote-first with optional in-person collaboration near office hubs