Sr. Prompt Engineer

Photon; New York (NY); On-site; USD 120,000 - 180,000; Full time

Job summary

Photon in New York is seeking a Senior Prompt Engineer to design, develop, test, and optimize prompts and interaction strategies for Large Language Models and Generative AI applications. You will work with AI/ML engineers, data scientists, software engineers, product managers, and stakeholders to deliver reliable, scalable AI solutions.

The ideal candidate has hands-on experience with prompt engineering, LLMs, RAG, evaluation, AI agents, and Python, with a proven ability to translate complex

Qualifications

• Hands-on experience designing prompts for large language models and generative AI systems.
• Ability to translate business needs into effective AI instructions and workflows.
• Experience with evaluation frameworks and prompt testing.

Responsibilities

• Design, develop, test, and optimize prompts for LLM-powered applications.
• Create system prompts, templates, and multi-step prompt workflows.
• Apply zero-shot, few-shot, and structured prompting techniques.
• Develop prompts for structured outputs (JSON/schema) and RAG-based apps.
• Collaborate with engineering teams to improve retrieval context and grounding.
• Design strategies for AI agents and tool/function calling.
• Build evaluation/testing frameworks to measure quality, latency, and cost.
• Create evaluation datasets, test cases, and benchmarks for GenAI use cases.
• Identify and reduce hallucinations and irrelevant outputs.
• Maintain prompt versioning and reusable prompt libraries.
• Integrate prompts into production applications and APIs.

Skills

Prompt Engineering

LLMs

Generative AI

RAG

Python

Prompt evaluation

AI agents

Prompt versioning

Job description

We are Photon, one of the world’s largest Digital Platform Engineering companies providing a unique combination of Strategy Consulting, Creative Design and Technology Services to a wide range of customers. We are a high growth organization serving over 40% of Fortune 100 companies and truly believe that our people make the world of difference for our clients and our business. With Photon, you get the opportunity to learn and grow, build deep digital/technical expertise, and achieve your professional and personal aspirations.

Job Title: Senior Prompt Engineer

Location: New York, NY

Job Nature: Full Time

Duration: Long Term

Job Summary: We are looking for an experienced Senior Prompt Engineer to design, develop, test, and optimize prompts and interaction strategies for Large Language Models (LLMs) and Generative AI applications.
The Senior Prompt Engineer will work closely with AI/ML Engineers, Data Scientists, Software Engineers, Product Managers, Architects, and business stakeholders to develop reliable, scalable, and production-ready AI solutions.
The ideal candidate will have strong hands-on experience with Prompt Engineering, LLMs, Generative AI, RAG, prompt evaluation, AI agents, and Python, with the ability to translate complex business requirements into effective AI instructions, workflows, and evaluation frameworks. Modern production prompt engineering increasingly combines prompts with RAG, structured outputs, tool calling, agent orchestration, evaluation, and version management.

Key Responsibilities

• Design, develop, test, and optimize prompts for LLM-powered and Generative AI applications.
• Create reusable system prompts, prompt templates, and multi-step prompt workflows.
• Apply techniques such as zero-shot, few-shot, prompt chaining, and structured prompting to improve model outputs.
• Design prompts for structured outputs, including JSON and schema-based responses.
• Develop and optimize prompts for Retrieval-Augmented Generation (RAG) applications.
• Work with engineering teams to improve retrieval context, grounding, response relevance, and overall RAG performance.
• Design prompting strategies for AI agents and agentic workflows, including tool/function calling.
• Build systematic prompt evaluation and testing frameworks to measure accuracy, relevance, consistency, robustness, and quality.
• Create evaluation datasets, test cases, and benchmarks for different GenAI use cases.
• Identify and reduce hallucinations, irrelevant responses, and inconsistent model behavior.
• Perform prompt experimentation and comparative evaluation across different LLMs and model versions.
• Optimize prompts for quality, latency, token utilization, and cost efficiency.
• Maintain prompt versioning, documentation, reusable prompt libraries, and engineering standards.
• Collaborate with developers to integrate prompts into production applications and APIs.
• Work with AI/ML teams to determine when to use prompt engineering, RAG, or model customization/fine-tuning.
• Conduct adversarial testing and identify potential prompt injection, safety, and reliability issues.
• Define best practices and reusable standards for prompt engineering across GenAI applications.
• Monitor production AI behavior and continuously improve prompts based on evaluation results and user feedback.
• Mentor junior engineers and provide technical guidance on prompt engineering and GenAI development.
• Continuously identify opportunities to improve development practices, code quality, performance, and engineering efficiency.