Azure OpenAI RAG Engineer — Onsite Beltsville

SkyePoint Decisions, Inc.; Vansville (MD); On-site; USD 140,000 - 160,000; Full time

Benefits offered by this job

Certification incentive program

PTO

Floating federal holiday options

Health insurance options

401k matched

Job summary

SkyePoint Decisions, Inc. is seeking an experienced AI Engineer with Azure OpenAI experience to design and implement an AI inference and Retrieval-Augmented Generation (RAG) pipeline for the Department of State.

This on-site role in Beltsville, MD involves provisioning Azure OpenAI Service on Azure Government, configuring the RAG pipeline, and implementing a confidence scoring mechanism for validation queues.

Qualifications

• 3+ years with Azure OpenAI Service, API integration and deployment in enterprise environments.
• Experience building RAG pipelines using Azure AI Search or equivalent vector search tech.
• Proficient in Python or JavaScript/TypeScript for AI pipelines.
• Familiarity with LLM prompt engineering techniques (few-shot, chain-of-thought, system prompts).
• Experience with FedRAMP-authorized clouds, specifically Azure Government.
• REST API integrations for data feed ingestion (JSON APIs, rate limits, error handling).
• US Citizenship required; active Top Secret clearance or ability to obtain TS.
• Authorized to work in the United States.

Responsibilities

• Provision and configure Azure OpenAI Service on Azure Government aligned with FedRAMP High requirements.
• Design and implement RAG pipeline with Azure AI Search, including vector index and document chunking strategy.
• Build and maintain automated data ingestion for CISA KEV, NVD CVE, Microsoft Security Update Guide, and SharePoint libraries.
• Incorporate ServiceNow ticket context into AI prompts for accurate responses.
• Develop AI confidence scoring and display per-response in validation queue for analysts.
• Ensure CUI-safe prompt construction and avoid raw vaulted CUI data.
• Configure Azure AI Content Safety filters and monitor model performance, latency, and costs.
• Prepare AI system documentation including prompts, RAG config, and monitoring procedures.

Skills

Azure OpenAI Service

API integration

Python/JavaScript

Prompt engineering

FedRAMP Azure Government

REST API ingestion

Security clearance (Top Secret / TS)

US Citizenship

Tools

LangChain

Semantic Kernel

Azure AI Foundry

ServiceNow

Job description

SkyePoint Decisions, Inc. is seeking an experienced AI Engineer with Azure OpenAI experience to design and implement an AI inference and Retrieval-Augmented Generation (RAG) pipeline for the Department of State.

This on-site role in Beltsville, MD involves provisioning Azure OpenAI Service on Azure Government, configuring the RAG pipeline, and implementing a confidence scoring mechanism for validation queues.