Enterprise Prompt Engineer – AI, RAG & Compliance

NTT DATA North America; Jersey City (NJ); On-site; USD 75,000 - 85,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Flexible spending account

Health savings account

AD&D insurance

401k program

Job summary

NTT DATA seeks a Prompt Engineer in Jersey City, NJ to design, test and govern prompts, system instructions, and conversation patterns for AIRP LLM applications. You will ensure outputs are accurate, grounded, and compliant, while building reusable prompt libraries for enterprise use.

The role emphasizes prompt security, evaluation, and collaboration with engineers on deployment and monitoring in production systems.

Qualifications

• Strong understanding of LLM behavior, prompt design, tokenization, context windows and model limitations.
• Hands-on experience with major AI platforms and tooling.
• Ability to debug LLM outputs using structured testing and iterative refinement.
• Strong writing, analytical, communication, and stakeholder-management skills.

Responsibilities

• Design prompts for chatbots, copilots, RAG systems, document analysis and decision-support experiences.
• Develop system prompts, few-shot examples, tool-use instructions and response formats.
• Optimize prompts for KYC, underwriting, governance tracking, and related use cases.
• Build reusable prompt libraries and templates aligned to enterprise standards.
• Evaluate prompt performance using metrics like task success, groundedness, safety and latency.
• Collaborate with engineers on versioning, testing, deployment and CI/CD workflows.
• Support RAG quality by assessing retrieval context and source citations.
• Conduct adversarial testing for prompt injection and sensitive-data leakage.

Skills

LLM design

Tokenization

RAG systems

Embeddings

OpenAI APIs

Azure OpenAI

AWS Bedrock

LangChain

Copilot Studio

Power Platform

Tools

OpenAI APIs

Azure OpenAI

AWS Bedrock

Anthropic

LangChain

LlamaIndex

Semantic Kernel

Copilot Studio

Power Platform

Job description

NTT DATA seeks a Prompt Engineer in Jersey City, NJ to design, test and govern prompts, system instructions, and conversation patterns for AIRP LLM applications. You will ensure outputs are accurate, grounded, and compliant, while building reusable prompt libraries for enterprise use.

The role emphasizes prompt security, evaluation, and collaboration with engineers on deployment and monitoring in production systems.