Prompt Architect for Enterprise AI & LLM Governance

NTT DATA, Inc.

Jersey City (NJ)

Hybrid

USD 105,000 - 182,000

Full time

14 days+

A complete application in a minute

Tailored resume and cover letter, ready to send.

Get past ATS filters

Benefits offered by this job

Medical, dental, and vision insurance
Flexible spending account / HSA
Life and AD&D insurance
Short and long term disability
Paid time off
Employee assistance program
401k with company match
Voluntary or legally-required benefits

Job summary

NTT DATA North America is seeking a Prompt Engineer in Jersey City, NJ to design, test, and govern prompts for AIRP LLM applications and citizen-development experiences. You will ensure accurate outputs, grounded information, and safe interactions while aligning with compliance and cost considerations.

You will build and maintain prompt libraries, test suites, and guardrails, collaborating with engineers to deploy in production and monitor performance across enterprise use cases like KYC,

Qualifications

  • 3+ years of experience with LLM behavior, prompt design and evaluation.
  • 3+ years with major AI platforms (OpenAI, Azure OpenAI, AWS Bedrock, etc.).
  • 3+ years debugging LLM outputs with structured testing and refinement.
  • 3+ years handling prompt-security risks including data leakage and prompts attacks.
  • 3+ years creating repeatable prompt templates and enterprise governance evidence.

Responsibilities

  • Design prompts for chatbots, copilots, RAG systems, and knowledge assistants.
  • Develop system prompts, few-shot examples, tool-use instructions, and response formats.
  • Optimize prompts for governance, compliance, and risk sign-offs.
  • Build reusable prompt libraries aligned to enterprise standards and guardrails.
  • Evaluate prompt performance using task success, groundedness, and safety metrics.
  • Collaborate with engineers to implement versioning, testing, deployment, and monitoring.
  • Conduct adversarial testing for prompt injections and data leakage.

Skills

LLM behavior
Prompt design
Tokenization
Context windows
RAG
Embeddings
Model limitations

Tools

OpenAI APIs
Azure OpenAI
AWS Bedrock
Anthropic
LangChain
LlamaIndex
Semantic Kernel
Copilot Studio

Job description

NTT DATA North America is seeking a Prompt Engineer in Jersey City, NJ to design, test, and govern prompts for AIRP LLM applications and citizen-development experiences. You will ensure accurate outputs, grounded information, and safe interactions while aligning with compliance and cost considerations.

You will build and maintain prompt libraries, test suites, and guardrails, collaborating with engineers to deploy in production and monitor performance across enterprise use cases like KYC,

Get your free, confidential resume review.

or drag and drop your file here.

Similar jobs

Similar jobs worth comparing

Prompt Engineer
Prompt Engineer

NTT DATA, Inc. • Jersey City (NJ)

Hybrid
USD 105,000 - 182,000
Medical, dental, and vision insurance
Flexible spending account / HSA
Life and AD&D insurance
+5
Senior AI Prompt Engineer — Hybrid, Cutting-Edge LLM
Senior AI Prompt Engineer — Hybrid, Cutting-Edge LLM

Persistent Systems • Whippany (NJ)

Hybrid
USD 150,000 - 190,000
Health coverage: Mediclaim
Group term life
Flexible work hours
+3
Senior Prompt Engineer & LLM Architect (Remote)
Senior Prompt Engineer & LLM Architect (Remote)

Bright Vision Technologies • United States

Remote
USD 76,000 - 99,000
Senior Prompt Architect for LLM & GenAI Systems
Senior Prompt Architect for LLM & GenAI Systems

Photon • New York (NY)

On-site
USD 120,000 - 180,000
AI Prompt Engineer
AI Prompt Engineer

Bpmcpa • United States

Remote
USD 110,000 - 160,000
Remote work
Flexible schedule
Senior AI Engineer: LLMs, Prompting & Agent Architect
Senior AI Engineer: LLMs, Prompting & Agent Architect

Astir IT Solutions, Inc. • Dallas (TX)

On-site
USD 150,000 - 190,000
Senior Prompt Engineer — LLM Tuning & AutoPrompt Ops
Senior Prompt Engineer — LLM Tuning & AutoPrompt Ops

Remote • San Francisco (CA)

Remote
USD 140,000 - 210,000
AI Prompt Developer
AI Prompt Developer

Bpmcpa • United States

Remote
USD 90,000 - 130,000
Senior AI Prompt Engineer — LLM Frameworks & Impact
Senior AI Prompt Engineer — LLM Frameworks & Impact

GE Vernova, Inc. • Town of Niskayuna (NY)

On-site
USD 131,700 - 219,300
Relocation assistance
GenAI Prompt Engineering
GenAI Prompt Engineering

Latitude • New York (NY)

On-site
USD 140,000 - 220,000