Prompt Engineer - Enterprise AI

Moonfire; Sioux Falls (SD); On-site; USD 90,000 - 130,000; Full time

Job summary

White Tree Solutions is seeking a Prompt Engineer to design, test, and refine AI interactions for enterprise use cases. This role combines clear instruction design with systematic evaluation to ensure AI outputs are useful, grounded, and consistent.

You will collaborate with architects, business analysts, governance specialists, and end users to translate requirements into tested behavior. The role requires hands-on work with LLMs, development of test datasets, and adherence to security and

Qualifications

• Hands-on experience building and evaluating apps using large language models.
• Strong writing skills to express requirements as clear instructions.
• Experience developing repeatable tests and analyzing AI outputs.
• Understanding grounding, retrieval-augmented generation, context limitations, and model failure modes.
• Ability to work with technical teams and explain tradeoffs to business stakeholders.

Responsibilities

• Develop system instructions, prompt templates, examples, and response formats for approved use cases.
• Define how AI solutions should use supplied context, retrieve information, handle ambiguity, and elevate unsupported requests.
• Build representative test cases and evaluation criteria covering accuracy, relevance, instruction adherence, and appropriate refusals.
• Evaluate behavior under ambiguous questions, incomplete context, conflicting instructions, and adversarial inputs.
• Diagnose failure patterns and recommend changes to prompts, source content, retrieval, or application design.
• Maintain versioned prompt documentation, test results, and release recommendations.
• Collaborate with security and engineering teams on safeguards that require controls beyond prompt instructions.

Skills

LLM applications

Technical writing

Test design

Prompt engineering

Stakeholder communication

Tools

Python

APIs

Evaluation workflows

Job description

White Tree Solutions

White Tree Solutions is seeking a Prompt Engineer to design, test, and refine AI interactions for enterprise use cases. This role combines clear instruction design with systematic evaluation to help AI solutions produce useful, grounded, and consistent responses.

You will collaborate with architects, business analysts, governance specialists, and end users to translate business requirements into tested AI behavior.

Responsibilities

• Develop system instructions, prompt templates, examples, and response formats for approved use cases.
• Define how AI solutions should use supplied context, retrieve information, handle ambiguity, and elevate unsupported requests.
• Build representative test cases and evaluation criteria covering accuracy, relevance, instruction adherence, and appropriate refusals.
• Evaluate behavior under ambiguous questions, incomplete context, conflicting instructions, and adversarial inputs.
• Diagnose failure patterns and recommend changes to prompts, source content, retrieval, or application design.
• Maintain versioned prompt documentation, test results, and release recommendations.
• Collaborate with security and engineering teams on safeguards that require controls beyond prompt instructions.

Qualifications

• Hands-on experience building and evaluating applications using large language models.
• Strong writing skills and the ability to express complex requirements as clear instructions.
• Experience developing repeatable tests and analyzing AI outputs.
• Understanding of grounding, retrieval-augmented generation, context limitations, and common model failure modes.
• Ability to work with technical teams and explain tradeoffs to business stakeholders.

Preferred Experience

• Microsoft Foundry, Copilot Studio, or Microsoft Fabric data agents.
• Python, APIs, and automated evaluation workflows.
• Conversational analytics or enterprise knowledge assistants.
• AI solutions subject to formal governance and release controls.

Expected Deliverables

A documented prompt library, evaluation dataset, test results, and recommendations for improving AI behavior and release readiness.

Citizenship and Work Location Requirements

Candidates must be U.S. citizens. This role supports a government engagement that prohibits offshoring. All work, including access to client systems and data, must be performed within the United States throughout the engagement. Offshore delivery and subcontracting are not permitted.