Senior AI Architect: LLM Platforms & Agentic Systems

CloudBigD

Edina (MN)

On-site

USD 160,000 - 230,000

Full time

Just now
Be an early applicant

Get a reply from this employer

Your resume and cover letter, tailored to exactly what they’re hiring for.

Get past ATS filters

Job summary

CloudBigD is hiring an AI Architect to serve as the hands-on design authority for enterprise AI and AI-enabled applications. You will design secure, scalable AI architectures, guide engineering teams through rapid AI-driven development, and ensure production readiness with governance and observability built in.

The role requires translating business outcomes into repeatable, secure architectures, evaluating new AI technologies, and leading solution designs that balance AI acceleration with

Qualifications

  • 12+ years of experience across software engineering, solution architecture, cloud/platform architecture, data, or AI/ML systems.
  • Strong hands-on experience delivering LLM and Agentic AI solutions.
  • Experience with agent orchestration, RAG, vector databases, hybrid search, context engineering, memory, tool calling, and API integration.
  • Strong understanding of APIs, microservices, cloud-native engineering, data architecture, CI/CD, security, observability, and DevOps.
  • Experience architecting AI systems on Azure, AWS, GCP, or equivalent enterprise cloud platforms.
  • Practical understanding of LLM/AI evaluation, including LLM-as-a-judge, regression testing, prompt evaluation, grounding, and probabilistic system validation.
  • Experience designing solutions that combine LLMs/agents with deterministic software components.
  • Experience taking AI solutions from prototype/PoC through production hardening and deployment.
  • Ability to create and communicate architecture blueprints, reference architectures, design patterns, technical standards, and ADRs.
  • Ability to work directly with business stakeholders and engineering teams to rapidly turn ambiguous problems into executable solution architectures.

Responsibilities

  • Design end-to-end architectures for LLM-powered applications, agentic AI, multi-agent systems, RAG, AI-assisted workflows, and autonomous solutions.
  • Define patterns that combine LLM-based reasoning with deterministic logic for reliable, compliant processes.
  • Design reusable architectural components including agent templates, shared libraries, RAG pipelines, vector stores, hybrid search, context management, memory, and tool/API integration.
  • Translate business requirements and rapid prototypes into secure, scalable, production-ready architectures.
  • Provide hands-on architectural guidance during rapid prototyping and solution build sessions.
  • Architect reusable AI platform capabilities that accelerate delivery across engineering teams.
  • Define patterns for agent registries, model management, AI BOM, model provenance, versioning, and context/resource connectivity.
  • Design model-routing strategies covering SLMs/LLMs, semantic caching, fallback models, latency optimization, token utilization, and cost optimization.
  • Establish AI observability covering telemetry, traces, evaluation results, operational monitoring, auditability, and cost visibility.
  • Support AI platform capabilities through CI/CD, automation, infrastructure, and policy-as-code.
  • Define architecture aligned with an AI-native delivery loop.
  • Establish exit criteria for prototype/sandbox-to-production graduation.
  • Enable teams to move from idea to prototype with production-ready standards.
  • Drive early architectural decisions to reduce ambiguity and debt.
  • Help teams distinguish between AI acceleration and traditional engineering needs.
  • Create reusable reference architectures, patterns, ADRs, and accelerators.

Skills

Solution architecture
AI/ML systems
Cloud-native
Security
Observability
DevOps
Architecture ADRs
Model governance
Agentic AI
LLM/Agent integration

Tools

Azure OpenAI
OpenAI
LangChain
Semantic Kernel

Job description

CloudBigD is hiring an AI Architect to serve as the hands-on design authority for enterprise AI and AI-enabled applications. You will design secure, scalable AI architectures, guide engineering teams through rapid AI-driven development, and ensure production readiness with governance and observability built in.

The role requires translating business outcomes into repeatable, secure architectures, evaluating new AI technologies, and leading solution designs that balance AI acceleration with

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI Solution Architect: Enterprise LLM & Cloud-Native
Senior AI Solution Architect: Enterprise LLM & Cloud-Native

CloudBigD • Iowa

On-site
USD 150,000 - 210,000
Enterprise AI Architect: Agentic Systems & LLMs
Enterprise AI Architect: Agentic Systems & LLMs

CloudBigD • Dallas (TX)

On-site
USD 150,000 - 210,000
Senior AI Platform Architect (LLMs, Cloud & DevOps)
Senior AI Platform Architect (LLMs, Cloud & DevOps)

GAC Solutions • Tampa (FL)

On-site
USD 150,000 - 210,000
Senior AI Platform Architect: Cloud-Native & LLMs
Senior AI Platform Architect: Cloud-Native & LLMs

Informa Group • Massachusetts

Hybrid
USD 180,000 - 230,000
401k match
Health insurance
Career development & training
Remote AI Solutions Architect – Enterprise GenAI
Remote AI Solutions Architect – Enterprise GenAI

CloudBigD • Tampa (FL)

Remote
USD 118,000 - 152,000
Senior AI Solution Architect - Hands-on LLM & Cloud
Senior AI Solution Architect - Hands-on LLM & Cloud

Valiant Technologies LLC • Iowa

On-site
USD 150,000 - 230,000
Senior AI Engineer: Generative AI, LLMs & RAG
Senior AI Engineer: Generative AI, LLMs & RAG

CloudBigD • Dallas (TX)

On-site
USD 150,000 - 190,000
Senior AI Platform Architect for Enterprise LLM & Cloud
Senior AI Platform Architect for Enterprise LLM & Cloud

highmetric • United States

Remote
USD 160,000 - 210,000
Senior AI Platform Architect & Lead, LLM Systems
Senior AI Platform Architect & Lead, LLM Systems

Inspira Financial • New York (NY)

On-site
USD 250,000 - 350,000
AI Platform Architect & Delivery Lead
AI Platform Architect & Delivery Lead

Ethereum Technologies • Edina (MN)

On-site
USD 150,000 - 190,000