Senior Prompt Engineer: LLM Tuning & Auto-Rater Expert

Welo Global; Town of Italy (NY); Remote; USD 90,000 - 130,000; Full time

Job summary

Welo Global is seeking a Prompt Engineer in the United States, specifically in New York. This role involves managing the technical migration workflow for transitioning templates to LLM auto-raters utilizing Automatic Prompt Generation tools. Candidates should have a Bachelor's, Master's, or Doctorate in related fields and at least 4 years of experience in prompt engineering. Native Italian and fluent English are required. Optional skills include familiarity with LLM interfaces and AI model evaluation.

Qualifications

• At least 4 years of experience as a Prompt Engineer.
• Proven experience tuning Large Language Models (LLMs).
• Ability to analyze model performance and identify error patterns.

Responsibilities

• Utilize Automatic Prompt Generation tools to create baseline prompts.
• Run and supervise Automated Prompt Optimization tool.
• Manually draft and refine prompts for complex template architectures.
• Monitor shadow-bot runs for quality assurance.
• Draft technical launch readiness justifications for final release.

Skills

Native fluency in Italian

Fluent in English

Experience in Prompt Engineering

SQL proficiency

Strong communication skills

Education

Bachelor’s, Master’s, or Doctorate in Computer Science, Data Science, or related field

Job description

Welo Global is seeking a Prompt Engineer in the United States, specifically in New York. This role involves managing the technical migration workflow for transitioning templates to LLM auto-raters utilizing Automatic Prompt Generation tools. Candidates should have a Bachelor's, Master's, or Doctorate in related fields and at least 4 years of experience in prompt engineering. Native Italian and fluent English are required. Optional skills include familiarity with LLM interfaces and AI model evaluation.