Azure AI Architect

Software Technology Inc.; United States; On-site; USD 150,000 - 230,000; Full time

Job summary

Software Technology Inc. is seeking a seasoned Azure AI Architect in the United States to lead the design and implementation of GenAI, LLM-based solutions, and agentic AI systems.

You will own the Azure AI architecture roadmap, mentor engineers, and partner with business leaders to drive enterprise AI initiatives. The role demands deep hands-on experience with Azure OpenAI, LangChain, LangGraph, and secure, scalable architectures.

Qualifications

• Seasoned AI architect with 12–15 years in AI/ML engineering and architecture.
• Proven experience on Generative/Agentic AI for production-grade deployments.
• Hands-on with Azure-native AI services and scalable solution design.

Responsibilities

• Define and own the Azure AI architecture roadmap for GenAI, search, and agentic AI.
• Design scalable, secure, cost-optimized architectures using Azure-native services.
• Provide technical leadership to AI/ML engineers and data scientists.
• Partner with leaders to align AI initiatives with enterprise goals.
• Architect and deliver Generative AI solutions using Azure OpenAI and related services.
• Design agentic AI workflows with LangChain and tool calling patterns.
• Build autonomous agents capable of reasoning, planning, and orchestration.
• Establish best practices for prompt engineering, evaluation, and governance.

Skills

Azure AI

Generative AI

LangChain

LangGraph

Leadership

Governance

Tools

Azure OpenAI

Azure AI Foundry

Cosmos DB

Job description

We are seeking a seasoned Azure AI Architect with deep expertise in Azure Generative AI, LLM-based solutions, and agentic AI systems. The ideal candidate brings 12-15 years of experience in AI/ML engineering and architecture, 2 years of experience on Generative/ Agentic AI, strong leadership capabilities, and hands-on experience designing and deploying production-grade AI solutions on Azure. This role combines strategic architecture ownership with hands-on technical leadership.

ROLES & RESPONSIBILITIES

AI Architecture & Technical Leadership

• Define and own the Azure AI architecture roadmap for GenAI, search, recommendation, and agentic AI solutions.
• Design scalable, secure, and cost-optimized AI architectures using Azure-native services.
• Provide technical leadership and mentorship to AI/ML engineers and data scientists.
• Partner with business and engineering leaders to align AI initiatives with enterprise objectives.
• Architect and deliver Generative AI solutions using Azure OpenAI, Azure AI Foundry, and Azure AI Services.
• Design and implement agentic AI workflows using LangChain, LangGraph, and tool/function calling patterns.
• Build autonomous and semi-autonomous agents capable of reasoning, planning, and orchestration.
• Establish best practices for prompt engineering, evaluation, monitoring, and governance.

LLMs, APIs & Application Integration

• Integrate LLMs into enterprise applications using Azure Functions, REST APIs, and event-driven architectures.
• Implement secure, scalable API layers for AI services with authentication, throttling, and observability.
• Drive adoption of LLMOps practices including prompt versioning, model monitoring, and feedback loops.

Search, Retrieval & Data Platforms

• Architect RAG-based solutions using Azure AI Search (Cognitive Search), Cosmos DB, and vector stores.
• Design semantic search, ranking, and recommendation pipelines for high-quality user experiences.
• Implement real-time and batch feedback loops to continuously improve relevance and accuracy.

MLOps, Security & Responsible AI

• Define end-to-end ML/GenAI lifecycle architecture: ingestion, orchestration, deployment, monitoring.
• Leverage Azure-native DevOps and CI/CD pipelines for AI workloads.
• Ensure compliance with Responsible AI, data governance, security, and enterprise standards.