Senior Azure AI Solutions Architect / Engineer

GovCIO; Hartford (CT); Remote; USD 180,000 - 220,000; Full time

Benefits offered by this job

Employee Assistance Program (EAP)

Corporate Discounts

Learning & Development platform

Job summary

GovCIO is hiring a Senior Azure AI Solutions Architect/Engineer to lead enterprise Generative AI initiatives within a federal environment. You will design, build, and secure Azure AI-powered solutions across document intelligence, retrieval, and automation, collaborating with IBM FileNet/DataCap teams.

The role demands hands-on implementation, testing, and knowledge transfer to existing teams, with remote work and a focus on secure, scalable production deployments for a Washington DC metro

Qualifications

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, Engineering, or a related technical discipline with 12 years (or commensurate experience).
• Clearance Level: Public Trust
• 8+ years of progressive experience designing, developing, and implementing enterprise software, cloud, or data solutions.
• 5+ years in senior engineering or architecture roles.
• 3+ years hands-on experience designing or implementing AI/ML solutions.
• 2+ years experience with Generative AI, LLM, and/or RAG-based applications.
• Experience with Microsoft Azure architecture and security controls (Entra ID, RBAC, Key Vault).
• Experience integrating LLMs with enterprise data sources and applications.

Responsibilities

• Lead architecture, design, development, and implementation of enterprise Generative AI solutions using Azure AI.
• Design and implement solutions using Azure Foundry, Azure OpenAI, Azure AI Search, and related services.
• Architect and implement Retrieval-Augmented Generation (RAG) over enterprise data.
• Develop AI-assisted enterprise search capabilities across large document repositories.
• Ensure secure integration patterns between Azure AI and existing applications, databases, and repositories.
• Implement AI capabilities via REST APIs, SDKs, Java services, and approved patterns.
• Evaluate Azure Document Intelligence for classification, extraction, and confidence scoring.
• Mentor architects and developers on Azure AI, RAG, and responsible AI development.
• Provide hands-on knowledge transfer for ongoing maintenance by the tech org.

Skills

Azure AI

RAG

LLM integration

Azure OpenAI

Python/Java

REST APIs

Security controls

Data extraction

AI evaluation

DevSecOps

Education

Bachelor's degree in Computer Science or related

Tools

Microsoft Foundry

Azure AI Document Intelligence

Azure AI Search

IBM FileNet

IBM DataCap

Azure Entra ID / RBAC / Key Vault

Job description

United States; Washington, Washington, DC

Suitability/Public Trust

Fully remote

Software Engineering Services

Overview

GovCIO is currently hiring for a highly experienced, hands-on Senior Azure AI Solutions Architect / Engineer to lead the architecture, development, and implementation of enterprise Generative AI and intelligent document solutions within a complex federal application environment.

This individual will serve as a technical leader for the adoption of Microsoft Azure AI capabilities, working alongside existing application architects, developers, infrastructure teams, and subject matter experts to introduce secure, scalable AI capabilities into established enterprise systems.

Initial efforts will focus on AI-assisted document intelligence, enterprise search and retrieval, Retrieval-Augmented Generation (RAG), document summarization, structured data extraction, document classification, and AI-assisted business process automation.

The successful candidate must be equally comfortable designing the architecture and building the solution. This is not solely an advisory or strategy position. The individual will be expected to configure Azure AI services, develop prototypes and production solutions, integrate with existing applications and data repositories, troubleshoot technical challenges, establish AI development patterns, and transfer knowledge to existing technical teams.

The position is remote and supports a federal customer in the Washington, D.C. metropolitan area.

Responsibilities

• Lead the architecture, design, development, and implementation of enterprise Generative AI solutions using the Microsoft Azure AI ecosystem.

• Design and implement solutions using Microsoft Foundry, Azure OpenAI/model services, Azure AI Search, Azure AI Document Intelligence , and related Azure capabilities.

• Architect and implement Retrieval-Augmented Generation (RAG) solutions over enterprise structured and unstructured data.

• Develop AI-assisted enterprise search capabilities capable of identifying relevant documents, pages, data elements, and supporting evidence across large document repositories.

• Develop capabilities for natural-language question answering, document summarization, information extraction, structured output generation, and AI-assisted research.

• Design and implement semantic, vector, hybrid, and agentic retrieval approaches as appropriate for specific business requirements.

• Develop secure integration patterns between Azure AI services and existing enterprise applications, APIs, databases, and document repositories.

• Integrate AI functionality into existing enterprise applications through REST APIs, SDKs, Java services, and other approved integration patterns.

• Evaluate and implement Azure AI Document Intelligence capabilities for document classification, metadata/data extraction, confidence scoring, and exception handling.

• Design AI agents and orchestration workflows using Microsoft Foundry capabilities when appropriate.

• Partner with existing application, IBM FileNet and IBM DataCap technical teams to introduce AI capabilities while leveraging existing enterprise platforms and investments.

• Design solutions that preserve application-level authorization and ensure users only receive AI-generated information derived from data they are authorized to access.

• Implement appropriate Azure identity, access management, secrets management, networking, logging, monitoring, and security controls.

• Establish AI evaluation and testing frameworks measuring retrieval accuracy, extraction accuracy, groundedness, hallucination rates, confidence, latency, performance, and business outcomes.

• Develop and execute technical proofs of concept and MVPs and transition successful capabilities into secure, scalable production implementations.

• Work with business and technical stakeholders to translate business processes and pain points into actionable AI solutions.

• Evaluate alternative AI technologies and integration approaches and provide technical recommendations based on feasibility, security, cost, scalability, and business value.

• Establish reusable architecture patterns, development standards, and technical documentation for future enterprise AI implementations.

• Mentor existing architects and developers on Azure AI, RAG, LLM integration, prompt engineering, evaluation, and responsible AI development.

• Provide hands-on knowledge transfer so that successful AI capabilities can ultimately be maintained and expanded by the existing technical organization.

Qualifications

Required Education and Experience

• Bachelor's degree in Computer Science, Software Engineering, Information Systems, Data Science, Artificial Intelligence, Engineering, or a related technical discipline with 12 years (or commensurate experience.

• Clearance Level: Public Trust

Required Skills & Experience

• 8+ years of progressive experience designing, developing, and implementing enterprise software, cloud, or data solutions.

• 5+ years of experience serving in senior engineering, technical architecture, cloud architecture, or comparable solution-design roles.

• 3+ years of hands‑on experience designing or implementing AI/ML solutions.

• 2+ years of recent hands‑on experience designing and implementing Generative AI, LLM, and/or RAG-based applications.

• Demonstrated hands‑on experience with the Microsoft Azure AI ecosystem, including Microsoft Foundry/Azure AI Foundry and Azure-hosted foundation models.

• Demonstrated experience designing and implementing RAG architectures using enterprise data.

• Hands‑on experience with Azure AI Search or comparable enterprise semantic/vector search technologies.

• Strong understanding of:

• Vector embeddings and vector databases/search

• Semantic and hybrid search

• Chunking and document‑processing strategies

• Prompt engineering and context management

• Grounding and citation/source attribution

• LLM orchestration

• AI evaluation and hallucination mitigation

• Experience integrating LLMs and AI services with enterprise data sources and applications.

• Experience designing and implementing secure REST API and SDK-based integrations.

• Experience with Python and/or Java for enterprise AI/application development.

• Experience with Microsoft Azure architecture, including Entra ID, RBAC, managed identities, Key Vault, networking, storage, monitoring, and logging.

• Demonstrated ability to design solutions involving sensitive or restricted enterprise information with appropriate data isolation and authorization controls.

• Demonstrated experience taking at least one enterprise AI/ML solution from architecture or proof‑of‑concept through production deployment.

• Experience establishing technical architecture while remaining directly involved in hands‑on development and troubleshooting.

• Demonstrated ability to communicate complex AI architecture and technical concepts to both technical and non‑technical stakeholders.

• Experience mentoring developers and transferring technical knowledge to existing engineering teams.

Preferred Skills & Experience

• Candidates located in the DC area are highly preferred

• Hands‑on experience with Azure AI Document Intelligence, including document classification, custom extraction, structured data extraction, confidence scoring, and exception processing.

• Experience building enterprise document intelligence, document search, or knowledge retrieval solutions involving large volumes of unstructured content.

• Experience integrating AI solutions with enterprise content‑management systems such as IBM FileNet.

• Experience with IBM DataCap or comparable enterprise document capture and processing platforms.

• Experience integrating AI functionality into existing Java‑based enterprise applications.

• Experience with Microsoft Foundry Agent Service and agentic AI architectures.

• Experience with Microsoft Copilot Studio, including agents, connectors, actions, and enterprise workflow integration.

• Experience with Azure DevOps, Git, CI/CD, Infrastructure as Code, and DevSecOps practices for AI‑enabled applications.

• Experience implementing AI evaluation frameworks and automated testing for production LLM applications.

• Experience with document‑level/page‑level citations, source attribution, and explainable/traceable AI responses.

• Experience implementing human‑in‑the‑loop workflows and confidence‑based exception routing.

• Knowledge of responsible AI principles, model governance, data privacy, and AI risk management.

• Experience working with PII, financial, benefits, healthcare, or other regulated/sensitive information.

• Experience delivering solutions within federal government environments, including familiarity with FedRAMP, NIST controls, FISMA, ATO processes, and federal security requirements.

• Experience evaluating AI platforms, models, and services based on cost, performance, security, accuracy, and operational suitability.

• Experience with IBM watsonx or other enterprise AI platforms is beneficial but not required.

#dl #rt #tk, #tmk #ar

Posted Salary Range

USD $180,000.00 - USD $220,000.00 /Yr.

Company Overview

GovCIO is a team of transformers--people who are passionate about transforming government IT. Every day, we make a positive impact by delivering innovative IT services and solutions that improve how government agencies operate and serve our citizens.

But we can't do it alone. We need great people to help us do great things - for our customers, our culture, and our ability to attract other great people. We are changing the face of government IT and building a workforce that fuels this mission. Are you ready to be a transformer?

What You Can Expect

Interview & Hiring Process

If you are selected to move forward through the process, here’s what you can expect:

• During the Interview Process

• Virtual video interview conducted via video with the hiring manager and/or team

• Camera must be on

• A valid photo ID must be presented during each interview

• During the Hiring Process

• Enhanced Biometrics ID verification screening

• Background check, to include:

• Criminal history (past 7 years)

• Verification of your highest level of education

• Verification of your employment history (past 7 years), based on information provided in your application

Employee Perks

• Employee Assistance Program (EAP)

• Corporate Discounts

• Learning & Development platform, to include certification preparation content

• Training, Education and Certification Assistance*

• Referral Bonus Program

• Internal Mobility Program

• Pet Insurance

• Flexible Work Environment

*Available to full‑time employees

Our employees’ unique talents and contributions are the driving force behind our success in supporting our customers, which ultimately fuels the success of our company. Join us and be a part of a culture that invests in its people and prioritizes continuous enhancement of the employee experience.

We are an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, disability, or status as a protected veteran. EOE, including disability/vets.

Posted Pay Range

The posted pay range, if referenced, reflects the range expected for this position at the commencement of employment, however, base pay offered may vary depending on multiple individualized factors, including market location, job-related knowledge, skills, education, experience, and internal equity. The total compensation package for this position may also include other compensation elements, to be discussed during the hiring process. If hired, employee will be in an "at-will position" and the GovCIO reserves the right to modify base salary (as well as any other discretionary payment or compensation program) at any time, including for reasons related to individual performance, GovCIO or individual department/team performance, and market factors.