Prompt & LLM Prototyping Engineer

SimbirSoft; United States; Remote; USD 90,000 - 120,000; Full time

Job summary

SimbirSoft is seeking a middle-level Prompt Engineer to prototype and manage LLM-based solutions. You will leverage Python and SQL to build and test prompts, and you will work with the OpenAI API to tune model behavior.

You will prototype, test, and maintain the quality of LLM solutions, analyze logs and feedback, and collaborate with product teams to design effective dialogue scenarios and evaluate performance against golden sets.

Qualifications

• Experience with prompt engineering for LLMs.
• Proficiency in Python and SQL.

Responsibilities

• Evaluate the performance of LLM solutions and maintain golden sets.
• Configure model behaviour through prompt experimentation and prompts testing.
• Integrate models into products and collaborate with product teams on dialogue scenarios.
• Analyze logs and user feedback to derive actionable insights.

Skills

Python

SQL

OpenAI API

Job description

SimbirSoft is seeking a middle-level Prompt Engineer to prototype and manage LLM-based solutions. You will leverage Python and SQL to build and test prompts, and you will work with the OpenAI API to tune model behavior.

You will prototype, test, and maintain the quality of LLM solutions, analyze logs and feedback, and collaborate with product teams to design effective dialogue scenarios and evaluate performance against golden sets.