Principal AI Architect

CloudBigD

Edina (MN)

On-site

USD 160,000 - 230,000

Full time

5 hours ago
Be an early applicant

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Job summary

CloudBigD is hiring an AI Architect to serve as the hands-on design authority for enterprise AI and AI-enabled applications. You will design secure, scalable AI architectures, guide engineering teams through rapid AI-driven development, and ensure production readiness with governance and observability built in.

The role requires translating business outcomes into repeatable, secure architectures, evaluating new AI technologies, and leading solution designs that balance AI acceleration with

Qualifications

  • 12+ years of experience across software engineering, solution architecture, cloud/platform architecture, data, or AI/ML systems.
  • Strong hands-on experience delivering LLM and Agentic AI solutions.
  • Experience with agent orchestration, RAG, vector databases, hybrid search, context engineering, memory, tool calling, and API integration.
  • Strong understanding of APIs, microservices, cloud-native engineering, data architecture, CI/CD, security, observability, and DevOps.
  • Experience architecting AI systems on Azure, AWS, GCP, or equivalent enterprise cloud platforms.
  • Practical understanding of LLM/AI evaluation, including LLM-as-a-judge, regression testing, prompt evaluation, grounding, and probabilistic system validation.
  • Experience designing solutions that combine LLMs/agents with deterministic software components.
  • Experience taking AI solutions from prototype/PoC through production hardening and deployment.
  • Ability to create and communicate architecture blueprints, reference architectures, design patterns, technical standards, and ADRs.
  • Ability to work directly with business stakeholders and engineering teams to rapidly turn ambiguous problems into executable solution architectures.

Responsibilities

  • Design end-to-end architectures for LLM-powered applications, agentic AI, multi-agent systems, RAG, AI-assisted workflows, and autonomous solutions.
  • Define patterns that combine LLM-based reasoning with deterministic logic for reliable, compliant processes.
  • Design reusable architectural components including agent templates, shared libraries, RAG pipelines, vector stores, hybrid search, context management, memory, and tool/API integration.
  • Translate business requirements and rapid prototypes into secure, scalable, production-ready architectures.
  • Provide hands-on architectural guidance during rapid prototyping and solution build sessions.
  • Architect reusable AI platform capabilities that accelerate delivery across engineering teams.
  • Define patterns for agent registries, model management, AI BOM, model provenance, versioning, and context/resource connectivity.
  • Design model-routing strategies covering SLMs/LLMs, semantic caching, fallback models, latency optimization, token utilization, and cost optimization.
  • Establish AI observability covering telemetry, traces, evaluation results, operational monitoring, auditability, and cost visibility.
  • Support AI platform capabilities through CI/CD, automation, infrastructure, and policy-as-code.
  • Define architecture aligned with an AI-native delivery loop.
  • Establish exit criteria for prototype/sandbox-to-production graduation.
  • Enable teams to move from idea to prototype with production-ready standards.
  • Drive early architectural decisions to reduce ambiguity and debt.
  • Help teams distinguish between AI acceleration and traditional engineering needs.
  • Create reusable reference architectures, patterns, ADRs, and accelerators.

Skills

Solution architecture
AI/ML systems
Cloud-native
Security
Observability
DevOps
Architecture ADRs
Model governance
Agentic AI
LLM/Agent integration

Tools

Azure OpenAI
OpenAI
LangChain
Semantic Kernel

Job description

US Citizen, Green Card, H-1B, OPT-EAD, CPT, Other

Work Authorization: US Citizen, Green Card, OPT-EAD, CPT, H-1B, H4-EAD, Other
Job Description :
The AI Architect serves as a hands-on technical design authority for enterprise AI and AI-enabled application delivery. This role is responsible for designing secure, scalable, reusable AI architectures and enabling engineering teams to move AI solutions rapidly from experimentation to production.

The role combines hands-on solution architecture with systems-level thinking, covering LLM-enabled applications, agentic systems, AI platforms, RAG, context and memory management, evaluation, observability, security, and governance.
The ideal candidate can rapidly translate business outcomes into working architecture, evaluate emerging AI technologies objectively, guide engineering teams through AI-driven development lifecycle (AI-DLC) practices, and determine where AI acceleration is appropriate versus where deterministic engineering, controls, and human validation remain essential.

Key Responsibilities:

AI Solution Architecture
  • Design end-to-end architectures for LLM-powered applications, agentic AI, multi-agent systems, RAG, AI-assisted workflows, and autonomous solutions.
  • Define patterns that appropriately combine LLM-based reasoning with deterministic application logic for reliable and compliance-sensitive processes.
  • Design reusable architectural components including agent templates, shared libraries, RAG pipelines, vector stores, hybrid search, context management, memory, and tool/API integration.
  • Translate business requirements and rapid prototypes into secure, scalable, production-ready architectures.
  • Provide hands-on architectural guidance during rapid prototyping and solution build sessions.
  • Architect reusable AI platform capabilities that accelerate delivery across engineering teams.
  • Define patterns for agent registries, model management, AI Bill of Materials (AI-BOM), model provenance, versioning, and context/resource connectivity.
  • Design model-routing strategies covering SLMs/LLMs, semantic caching, fallback models, latency optimization, token utilization, and cost optimization.
  • Establish AI observability covering telemetry, traces, evaluation results, operational monitoring, auditability, and cost visibility.
  • Support AI platform capabilities through CI/CD, automation, infrastructure, and policy-as-code.
  • Define architecture aligned with an AI-native delivery loop:
  • Establish architectural and technical exit criteria for prototype/sandbox-to-production graduation.
  • Enable teams to move rapidly from idea to prototype while maintaining clear engineering standards for production readiness.
  • Drive early architectural decisions to reduce ambiguity and prevent technical debt.
  • Help engineering teams distinguish between what AI can accelerate and what requires traditional engineering, security, testing, and human validation.
  • Create reusable reference architectures, patterns, decision trees, and accelerators that compress future delivery cycles.
AI Evaluation, Security & Governance:
  • Establish evaluation frameworks covering LLM-as-a-judge, golden datasets, prompt testing, regression evaluation, groundedness, hallucination testing, and human-in-the-loop validation.
  • Integrate AI evaluation and validation into engineering and deployment pipelines.
  • Define security and privacy architecture for PII, PHI, sensitive enterprise data, identity, authorization, and data boundaries.
  • Design architectures supporting regulatory, privacy, audit, Responsible AI, and governance requirements.
  • Evaluate AI frameworks, models, platforms, and protocols using objective architectural criteria rather than vendor preference.
Technical Leadership:
  • Serve as the technical design authority for AI solutions and engineering teams.
  • Partner with Engineering, Enterprise Architecture, Security, Data, Product, and Operations teams.
  • Review solution designs and provide hands-on guidance on architecture, scalability, security, reliability, and production readiness.
  • Maintain reference architectures, architecture decision records, engineering standards, reusable patterns, and technical guardrails.
  • Continuously evaluate emerging AI technologies and determine where they should be incorporated into the enterprise AI ecosystem.
Required Qualifications:
  • 12+ years of experience across software engineering, solution architecture, cloud/platform architecture, data, or AI/ML systems.
  • Strong recent hands-on experience designing and delivering LLM and Agentic AI solutions.
  • Experience with agent orchestration, RAG, vector databases, hybrid search, context engineering, memory, tool calling, and API integration.
  • Strong understanding of application architecture, APIs, microservices, cloud-native engineering, data architecture, CI/CD, security, observability, and DevOps.
  • Experience architecting AI systems on Azure, AWS, GCP, or equivalent enterprise cloud platforms.
  • Practical understanding of LLM/AI evaluation, including LLM-as-a-judge, regression testing, prompt evaluation, grounding, and probabilistic system validation.
  • Experience designing solutions that combine LLMs/agents with deterministic software components.
  • Experience taking AI solutions from prototype/PoC through production hardening and deployment.
  • Strong ability to create and communicate architecture blueprints, reference architectures, design patterns, technical standards, and Architecture Decision Records (ADRs).
  • Ability to work directly with business stakeholders and engineering teams to rapidly turn ambiguous problems into executable solution architectures.
Preferred Experience:
  • Hands-on experience with modern AI development ecosystems such as Azure OpenAI, OpenAI, Anthropic Claude, Microsoft Copilot ecosystem, Semantic Kernel, LangChain/LangGraph, or equivalent technologies.
  • Experience with multi-agent architectures, MCP/tool connectivity, AI gateways, model routing, and agent registries.
  • Experience developing reusable AI platform components, harnesses, templates, SDKs, and engineering accelerators.
  • Experience establishing AI governance, model provenance, AI-BOM, auditability, FinOps, and Responsible AI controls.
  • Experience working with regulated or highly sensitive data environments such as healthcare, financial services, or life sciences.

We are an equal opportunity employer. All aspects of employment including the decision to hire, promote, discipline, or discharge, will be based on merit, competence, performance, and business needs. We do not discriminate on the basis of race, color, religion, marital status, age, national origin, ancestry, physical or mental disability, medical condition, pregnancy, genetic information, gender, sexual orientation, gender identity or expression, national origin, citizenship/ immigration status, veteran status, or any other status protected under federal, state, or local law.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

AI Architect
AI Architect

Valiant Technologies LLC • Edina (MN)

On-site
USD 180,000 - 260,000
AI Architect
AI Architect

Ethereum Technologies LLC • Edina (MN)

On-site
USD 150,000 - 190,000
AI Architect
AI Architect

Robotics Technologies LLC • Plano (TX)

On-site
USD 180,000 - 240,000
AI Architect
AI Architect

Quantum Technologies LLC • Edina (MN)

On-site
USD 180,000 - 240,000
AI Architect
AI Architect

Valiant Technologies LLC • Plano (TX)

On-site
USD 180,000 - 260,000
AI Architect
AI Architect

Ethereum Technologies LLC • Plano (TX)

On-site
USD 180,000 - 280,000
AI Architect
AI Architect

Robotic Process Automation LLC • Plano (TX)

On-site
USD 210,000 - 270,000
AI Architect
AI Architect

Quantum Technologies LLC • Plano (TX)

On-site
USD 150,000 - 230,000
AI architecture
AI architecture

Valiant Technologies LLC • Piscataway Township (NJ)

On-site
USD 110,000 - 152,000
AI architecture
AI architecture

Quantum Technologies LLC • Piscataway Township (NJ)

On-site
USD 124,000 - 143,000