Senior LLM Prompt Architect & Evaluation Lead

Moonfire; New York (NY); On-site; USD 150,000 - 230,000; Full time

Job summary

Moonfire is seeking an experienced prompts engineer to design, test, and refine prompts for advanced LLM-based systems. You will collaborate with product, engineering, and data science teams to translate business needs into effective prompt and agent workflows.

The role requires deep knowledge of LLM behavior, context windows, and tooling like LangChain, along with strong Python scripting and API integration skills.

Qualifications

• 8+ years of hands-on experience in prompt design and optimization.
• Proven ability to design evaluation frameworks for measuring prompt performance.
• Deep knowledge of LLMs, tooling, contexts, and orchestration frameworks.
• Proven cross-functional collaboration with product, engineering, and data teams.
• Strong Python scripting, API integration, and data analysis skills.
• Awareness of prompt security and safety practices.

Skills

Prompt design

Evaluation & experimentation

LLM & tooling

Cross-functional collaboration

Python scripting

API integration

Prompt security

Tools

LangChain

Job description

Moonfire is seeking an experienced prompts engineer to design, test, and refine prompts for advanced LLM-based systems. You will collaborate with product, engineering, and data science teams to translate business needs into effective prompt and agent workflows.

The role requires deep knowledge of LLM behavior, context windows, and tooling like LangChain, along with strong Python scripting and API integration skills.