Italian Senior Prompt Engineer: LLM Migration & Optimization

Welo Data; Deutschland; Remote; EUR 60.000 - 100.000; Vollzeit

Benefits dieser Stelle

Flexible hours

Remote work (100% )

Freelance/Independent contractor

Zusammenfassung

Welo Data is seeking a highly technical Senior Prompt Engineer to migrate templates into high-performance LLM autoraters. This role demands mastery in prompt engineering, APG/APO tooling, and rigorous quality metrics across German and English contexts.

The position is Part-Time, 100% remote, with Italy-based residency required. Ideal candidates hold advanced degrees and 4+ years in LLM tuning, with strong data analytics abilities and API tooling experience.

Qualifikationen

• Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related field.
• 4+ years of experience tuning LLMs for structured outputs, classification, and few-shot learning.
• Proficiency with SQL or data analytics tools to monitor performance.
• Goose API style interfaces and internal tools familiarity.

Aufgaben

• Architect end-to-end migration of templates to LLM autoraters.
• Lead optimization using APG and supervise APO tools to improve model performance.
• Measure quality against gold data baselines, tracking precision, recall, and F1 scores.
• Draft and refine complex prompts to address edge-cases and architecture gaps.

Kenntnisse

Prompt engineering

SQL

Data analytics

Goose API

CoT prompting

APO systems

Linguistics/semantics

Launch Certification Documentation

Ausbildung

Bachelor’s/Master’s/PhD in CS/DS/Computational Linguistics

Tools

APG

APO tools

Shadowbot monitoring

Jobbeschreibung

Are you an expert at navigating the complex architecture of Large Language Models? Welo Data is seeking a highly technical Senior Prompt Engineer based in Italy to lead the end-to-end migration of template workflows into high-performance LLM autoraters.

This is a specialized role for a technical architect who understands that "perfecting a prompt" is a rigorous engineering discipline. You will leverage advanced APG/APO tools and manual refinement to ensure our automated systems meet—and exceed—and human accuracy baselines in both German and English contexts.

The Mission: Automated Quality at Scale

• Architectural Migration: Take full ownership of the end-to-end technical migration of templates to LLM autoraters.
• Optimization Leadership: Utilize Automatic Prompt Generation (APG) and supervise Automated Prompt Optimization (APO) tools to push model performance past plateaus and logic deadlocks.
• Metrics-Driven Excellence: Continuously measure quality against "gold data" baselines, tracking precision, recall, and F1 scores to justify launch readiness.
• Edge-Case Engineering: Manually draft and refine complex prompts to overcome anti-patterns and architecture gaps that automated tools cannot solve.

Project Details

• Schedule: Part-Time (Set your own hours within project milestones).
• Location: 100% Remote (Must be currently based in Italy).
• Language: Native fluency in Italian and professional fluency in English.
• Employment Type: Freelance / Independent Contractor.

Candidate Profile

• Educational Foundation: Bachelor’s, Master’s, or PhD in Computer Science, Data Science, Computational Linguistics, or a related analytical field.
• Prompt Engineering Mastery: 4+ years of experience tuning LLMs for strict, structured outputs, complex classification, and few-shot learning.
• Analytical Power: High proficiency in identifying error patterns and using SQL or data analytics tools to monitor performance.
• Technical Agility: Fast learner capable of mastering proprietary internal tools and "Goose API" style interfaces with minimal oversight.

Preferred Technical Skills

• Familiarity with shadowbot monitoring and disagreement tracking between human and LLM ratings.
• Hands‑on experience with Chain-of-Thought (CoT) prompting and APO systems.
• Deep linguistic expertise, including a strong understanding of semantics and formal logic.
• Proven ability to draft high-level Launch Certification Documentation.