Prompt Architect for Enterprise AI & LLM Governance

NTT DATA North America; Jersey City (NJ); Hybrid; USD 105,000 - 182,000; Full time

Benefits offered by this job

Medical, dental, and vision insurance

Flexible spending account / HSA

Life and AD&D insurance

Short and long term disability

Paid time off

Employee assistance program

401k with company match

Voluntary or legally-required benefits

Job summary

NTT DATA North America is seeking a Prompt Engineer in Jersey City, NJ to design, test, and govern prompts for AIRP LLM applications and citizen-development experiences. You will ensure accurate outputs, grounded information, and safe interactions while aligning with compliance and cost considerations.

You will build and maintain prompt libraries, test suites, and guardrails, collaborating with engineers to deploy in production and monitor performance across enterprise use cases like KYC,

Qualifications

• 3+ years of experience with LLM behavior, prompt design and evaluation.
• 3+ years with major AI platforms (OpenAI, Azure OpenAI, AWS Bedrock, etc.).
• 3+ years debugging LLM outputs with structured testing and refinement.
• 3+ years handling prompt-security risks including data leakage and prompts attacks.
• 3+ years creating repeatable prompt templates and enterprise governance evidence.

Responsibilities

• Design prompts for chatbots, copilots, RAG systems, and knowledge assistants.
• Develop system prompts, few-shot examples, tool-use instructions, and response formats.
• Optimize prompts for governance, compliance, and risk sign-offs.
• Build reusable prompt libraries aligned to enterprise standards and guardrails.
• Evaluate prompt performance using task success, groundedness, and safety metrics.
• Collaborate with engineers to implement versioning, testing, deployment, and monitoring.
• Conduct adversarial testing for prompt injections and data leakage.

Skills

LLM behavior

Prompt design

Tokenization

Context windows

RAG

Embeddings

Model limitations

Tools

OpenAI APIs

Azure OpenAI

AWS Bedrock

Anthropic

LangChain

LlamaIndex

Semantic Kernel

Copilot Studio

Job description

NTT DATA North America is seeking a Prompt Engineer in Jersey City, NJ to design, test, and govern prompts for AIRP LLM applications and citizen-development experiences. You will ensure accurate outputs, grounded information, and safe interactions while aligning with compliance and cost considerations.

You will build and maintain prompt libraries, test suites, and guardrails, collaborating with engineers to deploy in production and monitor performance across enterprise use cases like KYC,