Prompt Architect for AI Interactions

UNAVAILABLE; McLean (VA); On-site; USD 120,000 - 180,000; Full time

Job summary

UNAVAILABLE is seeking a Prompt Engineer to design, test, and refine interaction patterns for generative AI systems used across client engagements. You will shape how users experience AI-powered applications, ensuring outputs are relevant, safe, and aligned to mission needs.

You will collaborate with AI developers, LLMOps engineers, evaluation scientists, and design teams to craft prompts and improve retrieval strategies.

Qualifications

• Bachelor’s degree or higher in Computer Science, Linguistics, Cognitive Science, Data Science, or related discipline.
• 5+ years of total experience.
• 2+ years of AI/ML, NLP, content design, UX writing, or similar roles involving structured interaction design.
• Experience designing and testing prompts for LLMs in real applications (GPT-style models; Claude, Gemini, Llama, etc.).
• Familiarity with RAG architectures, vector databases, embeddings, and context retrieval strategies.
• Strong analytical skills to run structured experiments and document findings.

Responsibilities

• Design, iterate, and optimize prompts, templates, and prompt chains to improve accuracy, reasoning, and usability of AI outputs.
• Develop context management strategies including document selection, summarization, formatting, and retrieval augmentation patterns.
• Partner with developers to implement prompt engineering techniques within RAG pipelines, agentic workflows, evaluation harnesses, and application UX layers.
• Conduct structured experiments including A/B tests and rubric-based evaluations to measure prompt performance and identify improvement opportunities.
• Collaborate with AI Evaluation Scientists to define evaluation metrics tied to quality, relevance, consistency, safety, and hallucination reduction.
• Work with UX and product design teams to develop interaction flows that guide user inputs and reduce cognitive load.
• Translate complex subject-matter content into structured, LLM-friendly formats to improve system reasoning and reduce error rates.
• Support the design of safe output behaviors by implementing guardrails, filtering strategies, and context constraints aligned with governance principles.
• Document prompt patterns, style guides, failure modes, and best practices for internal reuse.
• Stay up to date on prompting strategies (CoT, self-critique, tool-use scaffolding, function calling, agentic behaviors) and share insights.

Skills

Prompt engineering

A/B testing

UX writing

Cross-functional collaboration

Communication

Problem solving

Structured experimentation

Education

Bachelor’s degree or higher in CS / Linguistics / Cognitive Science / Data Science or related

Tools

Python

LangChain

LlamaIndex

Job description

UNAVAILABLE is seeking a Prompt Engineer to design, test, and refine interaction patterns for generative AI systems used across client engagements. You will shape how users experience AI-powered applications, ensuring outputs are relevant, safe, and aligned to mission needs.

You will collaborate with AI developers, LLMOps engineers, evaluation scientists, and design teams to craft prompts and improve retrieval strategies.