AI Architect

Programmers.io; Seattle (WA); On-site; USD 150,000 - 230,000; Full time

Job summary

Programmers.io seeks a senior software architect to design scalable, secure multi-agent orchestration using Azure OpenAI, AKS, Langraph, and MS Agent Framework. You will lead integration across data sources and ensure governance and scalability of AI agents.

Collaborate with engineers, data scientists, and DevOps to deploy robust AI solutions in a cloud-native environment, leveraging Python/C# and CI/CD practices.

Qualifications

• 8+ years in software architecture with 3+ years in enterprise AI and cloud solutions.
• Deep hands-on experience with Microsoft Azure core services, Azure OpenAI, and Azure AI Foundry.
• Proficiency in multi-agent frameworks like Microsoft AutoGen, Semantic Kernel, or LangChain.
• Advanced programming skills in Python or C# for agent logic and API integration.
• Knowledge of CI/CD, containerization (Docker, Kubernetes), and scaling LLM workloads.

Responsibilities

• Architecture Design: Build scalable, secure, and resilient multi-agent orchestration frameworks using Azure OpenAI Service, Azure AI Agent Service, and AKS.
• Agent Coordination: Define communication protocols, memory management, and task delegation patterns between autonomous AI agents.
• Cloud Integration: Connect AI agents to enterprise data sources via Azure Cosmos DB, Azure AI Search, and Azure SQL, Snowflake, Databricks.
• Security & Governance: Implement AI safety guardrails, RBAC, and monitoring using Azure AI Content Safety and Azure Monitor.
• Collaboration: Guide software engineers, data scientists, and DevOps teams through implementation and deployment.
• Evaluation of AI Agents: Evaluation of agents/LLMs for accuracy, consistency, and reducing hallucinations.

Skills

Software architecture

Enterprise AI

Cloud solutions

Azure expertise

Python or C#

MLOps

Tools

Azure OpenAI

Azure AI Foundry

LangChain

Semantic Kernel

Microsoft AutoGen

Langraph

Job description

• Architecture Design: Build scalable, secure, and resilient multi-agent orchestration frameworks using Azure OpenAI Service, Azure AI Agent Service, and Azure Kubernetes Service (AKS), frameworks such as Langraph and MS Agent Framework.
• Agent Coordination: Define communication protocols, memory management, and task delegation patterns between autonomous AI agents.
• Cloud Integration: Connect AI agents to enterprise data sources via Azure Cosmos DB, Azure AI Search, and Azure SQL, Snowflake , Databricks.
• Security & Governance: Implement AI safety guardrails, role-based access control (RBAC), and monitoring using Azure AI Content Safety and Azure Monitor.
• Collaboration: Guide software engineers, data scientists, and DevOps teams through implementation and deployment.
• Evaluation of AI Agents: evaluation of agents/LLMs (responses accuracy, consistency, hallucinations, etc).

Skills:

• Experience: 8+ years in software architecture, with 3+ years focused on enterprise AI and cloud solutions.
• Azure Expertise: Deep hands-on experience with Microsoft Azure core services, Azure OpenAI, and Azure AI Foundry.
• Frameworks: Proficiency in multi-agent frameworks like Microsoft AutoGen, Semantic Kernel, or LangChain.
• Coding Skills: Advanced programming skills in Python or C# for agent logic and API integration.
• MLOps: Knowledge of CI/CD pipelines, containerization (Docker, Kubernetes), and scaling LLM workloads.