Senior Azure AI Solutions Architect / Engineer

GovCIO

Washington (District of Columbia)

Remote

USD 180,000 - 220,000

Full time

14 days+
Application generator

Turn this role into an interview — a resume and cover letter built around what this employer wants.

Get past ATS filters

Job summary

GovCIO is seeking a highly experienced Senior Azure AI Solutions Architect/Engineer to lead the architecture, development, and implementation of enterprise Generative AI and intelligent document solutions for a federal environment.

You will configure Azure AI services, build production solutions, and transfer knowledge to existing technical teams while ensuring secure, scalable AI capabilities for a Washington, D.C.-area federal client.

Qualifications

  • Bachelor's degree in a technical field and 12+ years of experience.
  • Public Trust clearance.
  • Extensive experience designing and delivering enterprise AI/ML solutions.

Responsibilities

  • Lead architecture, design, development, and deployment of enterprise Generative AI solutions using Azure AI.
  • Design and implement solutions with Azure Foundry, Azure OpenAI, Azure AI Search, and Azure Document Intelligence.
  • Architect and implement RAG solutions over enterprise data and develop AI-assisted enterprise search capabilities.
  • Ensure secure integration with existing enterprise apps, APIs, databases and document repositories.
  • Mentor architects and developers on Azure AI, RAG, LLM integration and responsible AI practices.

Skills

Enterprise AI architecture
RAG architectures
LLM orchestration
Azure AI ecosystem
Prompt engineering
Python/Java
Security and IAM
Federally compliant architectures

Education

Bachelor's degree in Computer Science or related field

Tools

Azure Foundry / Azure AI Foundry
Azure OpenAI
Azure AI Document Intelligence
Azure AI Search
IBM FileNet
IBM DataCap
Azure DevOps

Job description

GovCIO is currently hiring for a highly experienced, hands-onSenior Azure AI Solutions Architect / Engineerto lead the architecture, development, and implementation of enterprise Generative AI and intelligent document solutions within a complex federal application environment.

This individual will serve as a technical leader for the adoption of Microsoft Azure AI capabilities, working alongside existing application architects, developers, infrastructure teams, and subject matter experts to introduce secure, scalable AI capabilities into established enterprise systems.

Initial efforts will focus onAI-assisted document intelligence, enterprise search and retrieval, Retrieval-Augmented Generation (RAG), document summarization, structured data extraction, document classification, and AI-assisted business process automation.

The successful candidate must be equally comfortabledesigning the architecture and building the solution. This is not solely an advisory or strategy position. The individual will be expected to configure Azure AI services, develop prototypes and production solutions, integrate with existing applications and data repositories, troubleshoot technical challenges, establish AI development patterns, and transfer knowledge to existing technical teams.

The position is remote and supports a federal customer in the Washington, D.C. metropolitan area.

Responsibilities
  • Lead the architecture, design, development, and implementation of enterprise Generative AI solutions using the Microsoft Azure AI ecosystem.
  • Design and implement solutions using Microsoft Foundry, Azure OpenAI/model services, Azure AI Search, Azure AI Document Intelligence, and related Azure capabilities.
  • Architect and implementRetrieval-Augmented Generation (RAG)solutions over enterprise structured and unstructured data.
  • Develop AI-assisted enterprise search capabilities capable of identifying relevant documents, pages, data elements, and supporting evidence across large document repositories.
  • Develop capabilities for natural-language question answering, document summarization, information extraction, structured output generation, and AI-assisted research.
  • Design and implement semantic, vector, hybrid, and agentic retrieval approaches as appropriate for specific business requirements.
  • Develop secure integration patterns between Azure AI services and existing enterprise applications, APIs, databases, and document repositories.
  • Integrate AI functionality into existing enterprise applications through REST APIs, SDKs, Java services, and other approved integration patterns.
  • Evaluate and implementAzure AI Document Intelligencecapabilities for document classification, metadata/data extraction, confidence scoring, and exception handling.
  • Design AI agents and orchestration workflows using Microsoft Foundry capabilities when appropriate.
  • Partner with existing application,IBM FileNet and IBM DataCaptechnical teams to introduce AI capabilities while leveraging existing enterprise platforms and investments.
  • Design solutions that preserve application-level authorization and ensure users only receive AI-generated information derived from data they are authorized to access.
  • Implement appropriate Azure identity, access management, secrets management, networking, logging, monitoring, and security controls.
  • Establish AI evaluation and testing frameworks measuring retrieval accuracy, extraction accuracy, groundedness, hallucination rates, confidence, latency, performance, and business outcomes.
  • Develop and execute technical proofs of concept and MVPs and transition successful capabilities into secure, scalable production implementations.
  • Work with business and technical stakeholders to translate business processes and pain points into actionable AI solutions.
  • Evaluate alternative AI technologies and integration approaches and provide technical recommendations based on feasibility, security, cost, scalability, and business value.
  • Establish reusable architecture patterns, development standards, and technical documentation for future enterprise AI implementations.
  • Mentor existing architects and developers on Azure AI, RAG, LLM integration, prompt engineering, evaluation, and responsible AI development.
  • Provide hands-on knowledge transfer so that successful AI capabilities can ultimately be maintained and expanded by the existing technical organization.
Qualifications
Required Education and Experience
  • Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, Engineering, or a related technical discipline with 12 years (or commensurate experience.
  • Clearance Level: Public Trust
Required Skills & Experience
  • 8+ years of progressive experiencedesigning, developing, and implementing enterprise software, cloud, or data solutions.
  • 5+ years of experienceserving in senior engineering, technical architecture, cloud architecture, or comparable solution-design roles.
  • 3+ years of hands-on experiencedesigning or implementing AI/ML solutions.
  • 2+ years of recent hands-on experiencedesigning and implementing Generative AI, LLM, and/or RAG-based applications.
  • Demonstrated hands-on experience with theMicrosoft Azure AI ecosystem, including Microsoft Foundry/Azure AI Foundry and Azure-hosted foundation models.
  • Demonstrated experience designing and implementingRAG architecturesusing enterprise data.
  • Hands-on experience withAzure AI Searchor comparable enterprise semantic/vector search technologies.
  • Strong understanding of:
    • Vector embeddings and vector databases/search
    • Semantic and hybrid search
    • Chunking and document-processing strategies
    • Prompt engineering and context management
    • Grounding and citation/source attribution
    • LLM orchestration
    • AI evaluation and hallucination mitigation
  • Experience integrating LLMs and AI services with enterprise data sources and applications.
  • Experience designing and implementing secureREST API and SDK-based integrations.
  • Experience withPython and/or Javafor enterprise AI/application development.
  • Experience with Microsoft Azure architecture, includingEntra ID, RBAC, managed identities, Key Vault, networking, storage, monitoring, and logging.
  • Demonstrated ability to design solutions involving sensitive or restricted enterprise information with appropriate data isolation and authorization controls.
  • Demonstrated experience takingat least one enterprise AI/ML solution from architecture or proof-of-concept through production deployment.
  • Experience establishing technical architecture while remaining directly involved in hands-on development and troubleshooting.
  • Demonstrated ability to communicate complex AI architecture and technical concepts to both technical and non-technical stakeholders.
  • Experience mentoring developers and transferring technical knowledge to existing engineering teams.
Preferred Skills & Experience
  • Candidates located in the DC area are highly preferred
  • Hands-on experience with Azure AI Document Intelligence, including document classification, custom extraction, structured data extraction, confidence scoring, and exception processing.
  • Experience buildingenterprise document intelligence, document search, or knowledge retrieval solutionsinvolving large volumes of unstructured content.
  • Experience integrating AI solutions with enterprise content-management systems such asIBM FileNet.
  • Experience withIBM DataCapor comparable enterprise document capture and processing platforms.
  • Experience integrating AI functionality into existingJava-based enterprise applications.
  • Experience with Microsoft Foundry Agent Service and agentic AI architectures.
  • Experience with Microsoft Copilot Studio, including agents, connectors, actions, and enterprise workflow integration.
  • Experience with Azure DevOps, Git, CI/CD, Infrastructure as Code, and DevSecOps practices for AI-enabled applications.
  • Experience implementing AI evaluation frameworks and automated testing for production LLM applications.
  • Experience with document-level/page-level citations, source attribution, and explainable/traceable AI responses.
  • Experience implementing human-in-the-loop workflows and confidence-based exception routing.
  • Knowledge of responsible AI principles, model governance, data privacy, and AI risk management.
  • Experience working with PII, financial, benefits, healthcare, or other regulated/sensitive information.
  • Experience delivering solutions withinfederal government environments, including familiarity with FedRAMP, NIST controls, FISMA, ATO processes, and federal security requirements.
  • Experience evaluating AI platforms, models, and services based on cost, performance, security, accuracy, and operational suitability.
  • Experience with IBM watsonx or other enterprise AI platforms is beneficial but not required.
Posted Salary Range

USD $180,000.00 - USD $220,000.00 /Yr.

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Senior AI/.NET Engineer
Senior AI/.NET Engineer

Milbank LLP • New York (NY)

On-site
USD 140,000 - 175,000
Programmer
Programmer

Atlas • Village of Tarrytown (NY)

On-site
USD 180,000 - 260,000
Remote Azure AI Architect for GenAI & Documents
Remote Azure AI Architect for GenAI & Documents

GovCIO • Washington

Remote
USD 180,000 - 220,000
Senior AI Solutions Engineer
Senior AI Solutions Engineer

New Directions Technologies, Inc • Port Hueneme (CA)

On-site
USD 85,000 - 114,000
Senior AI/ML Data Engineer
Senior AI/ML Data Engineer

Boeing Intelligence & Analytics • Washington

Hybrid
USD 242,000 - 305,000
ID Software/Application Engineer Professional (408)
ID Software/Application Engineer Professional (408)

Environmental and Safety Solutions, Inc. • Reston (VA)

On-site
USD 150,000 - 190,000
Senior AI Architect/Engineer
Senior AI Architect/Engineer

Technomics, Inc. • Arlington (VA)

On-site
USD 120,000 - 160,000
Solutions Architect - Azure AI Enterprise Architecture
Solutions Architect - Azure AI Enterprise Architecture

Dexian • Dublin (CA)

On-site
USD 129,100 - 220,600
Artificial Intelligence Engineer
Artificial Intelligence Engineer

The Phoenix Group • Boston (MA)

On-site
USD 140,000 - 180,000
Artificial Intelligence Engineer
Artificial Intelligence Engineer

The Phoenix Group • San Francisco (CA)

On-site
USD 170,000 - 250,000