Prompt Engineer

Creative Solutions Services, LLC; Jersey City (NJ); On-site; USD 75,000 - 85,000; Full time

Benefits offered by this job

Medical insurance

Dental insurance

Vision insurance

Flexible spending or HSA

AD&D insurance

Employee assistance

401k program

Additional voluntary benefits

Job summary

NTT DATA seeks a seasoned Prompt Engineer to design, test, and govern prompts for AIRP LLM applications in Jersey City, NJ. You will own prompt patterns, system instructions, and conversation policies across enterprise use cases, ensuring accuracy, grounding, safety, and cost-awareness.

With 8+ years of experience, you will evaluate performance, collaborate with engineers on CI/CD deployment, and drive reusable libraries while addressing security considerations and compliance expectations.

Qualifications

• 8+ years of experience in relevant roles.
• Strong understanding of LLM behavior, prompt design, tokenization and context windows.
• Hands-on experience with major AI platforms and toolchains (OpenAI, Azure OpenAI, AWS Bedrock, Anthropic, LangChain).
• Ability to debug LLM outputs with structured testing and error analysis.
• Excellent writing, analytical, communication and stakeholder-management skills.
• Understanding of prompt-security risks including data leakage and jailbreaks.

Responsibilities

• Design prompts for chatbots, copilots, RAG systems and decision-support experiences.
• Develop system prompts, few-shot examples, tool-use instructions and response formats.
• Optimize prompts for governance, compliance and enterprise use cases.
• Build reusable prompt libraries aligned to enterprise standards.
• Evaluate prompt performance using metrics like grounding, safety and latency.
• Collaborate with engineers to deploy prompts in production CI/CD workflows.
• Support RAG quality through retrieval context and citation behavior.
• Conduct adversarial testing for prompt injection and unsafe outputs.

Skills

LLM behavior

prompt design

tokenization

context windows

RAG

embeddings

model limitations

debug LLM outputs

structured testing

error analysis

iterative refinement

writing

analytical

communication

stakeholder-management

prompt-security risks

Tools

OpenAI APIs

Azure OpenAI

AWS Bedrock

Anthropic

LangChain

LlamaIndex

Semantic Kernel

Copilot Studio

Job description

NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization,

We are currently seeking a Prompt Engineer to join our team in Jersey City, New Jersey (US-NJ), United States (US).

Role purpose

• Design, test, govern, and continuously improve prompts, system instructions, conversation flows, and interaction patterns for AIRP LLM applications and related citizen-development experiences. The role ensures model outputs are accurate, grounded, safe, consistent, cost-aware, and aligned with business and compliance expectations.
• Client-specific emphasis
• Prompt work must support enterprise business use cases, not generic chatbot experimentation.
• Reusable prompt patterns should be suitable for AIRP and, where applicable, Copilot Studio / Power Platform citizen-development scenarios.
• Candidates must understand prompt security, sensitive data handling, citations/grounding, and structured evaluation.
• Primary ownership
• Prompt patterns, system instructions, response templates, and conversation policies for AIRP LLM use cases.
• Prompt testing, versioning, evaluation, and quality-improvement workflows.
• Reusable prompt libraries and guardrail patterns for business teams and responsible citizen development where applicable.

Key responsibilities

• Design prompts for chatbots, copilots, RAG systems, document analysis, summarization, workflow agents, knowledge assistants, and decision-support experiences.
• Develop system prompts, few-shot examples, tool-use instructions, response formats, escalation logic, citation behavior, and conversation policies.
• Optimize prompts for KYC support, credit underwriting support, governance tracking, pitch book generation, Banker 360, Customer 360, deal library intelligence, financial crime quality, and sanctions screening use cases.
• Build reusable prompt libraries and templates aligned to enterprise standards, business domains, AIRP patterns, and citizen-development guardrails.
• Evaluate prompt performance using metrics such as task success, groundedness, hallucination rate*** completeness, safety, user satisfaction, latency, and token cost.
• Partner with engineers to implement prompt versioning, testing, deployment, and monitoring in production systems and CI/CD workflows.
• Support RAG quality by assessing retrieval context, chunking quality, source citation behavior, response synthesis, and missing-context behavior.
• Conduct adversarial testing for prompt injection, jailbreaks, instruction conflicts, sensitive-data leakage, unsafe outputs, and unauthorized tool use.

Basic Qualifications

8 + years of experience

• Strong understanding of LLM behavior, prompt design, tokenization, context windows, RAG, embeddings, and model limitations.
• Hands-on experience with OpenAI APIs, Azure OpenAI, AWS Bedrock, Anthropic, LangChain, LlamaIndex, Semantic Kernel, Copilot Studio, or similar platforms.
• Ability to debug LLM outputs using structured testing, error analysis, and iterative refinement.
• Strong writing, analytical, communication, and stakeholder-management skills.
• Understanding of prompt-security risks including prompt injection, jailbreaks, data leakage, hallucination, and instruction conflicts.
• Ability to create repeatable prompt templates and evaluation evidence suitable for enterprise governance.

Preferred experience

• Background in NLP, conversational AI, UX writing, technical writing, product design, knowledge management, business analysis, or financial-services operations.
• Experience in financial services, legal, compliance, risk, operations, customer support, banker productivity, or enterprise knowledge domains.
• Familiarity with Microsoft Copilot Studio, Power Platform, prompt registries, A/B testing, human review workflows, and evaluation tooling.

#LI-NorthAmerica

Compensation and Benefits

NTT DATA provides a reasonable range of compensation for U.S.-based positions.

The starting pay range for this role is [75- 85 $ range].

Actual compensation will depend on a number of factors, including the candidate's relevant experience, technical skills, and other qualifications.

Benefits

• participation in medical
• dental
• vision insurance
• flexible spending or health savings account
• AD&D insurance
• employee assistance
• participation in a 401k program
• additional voluntary or legally-required benefits

About NTT DATA:

NTT DATA is a $30 billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long term success. As a Global Top Employer, we have diverse experts in more than 50 countries and a robust partner ecosystem of established and start-up companies. Our services include business and technology consulting, data and artificial intelligence, industry solutions, as well as the development, implementation and management of applications, infrastructure and connectivity. We are one of the leading providers of digital and AI infrastructure in the world. NTT DATA is a part of NTT Group, which invests over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the digital future.

Visit us at us.nttdata.com

NTT DATA endeavors to make https://us.nttdata.com accessible to any and all users. If you would like to contact us regarding the accessibility of our website or need assistance completing the application process, please contact us at https://us.nttdata.com/en/contact-us. This contact information is for accommodation requests only and cannot be used to inquire about the status of applications.

NTT DATA is an equal opportunity employer. Qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability or protected veteran status.

For our EEO Policy Statement, please click here. If you'd like more information on your EEO rights under the law, please click here. For Pay Transparency information, please click here.