Senior Prompt Architect — AI & LLM (Remote)

Ableneo; Wien; Hybrid; EUR 90,000 - 130,000; Full time

Benefits offered by this job

Engaging projects

Learning program

Flexible hours

Home office

Office perks

Job summary

Ableneo is seeking a Senior Prompt Engineer (M/F) for our banking sector client. You will shape and optimize AI agents used in conversational applications, focusing on prompt development, agent configuration and systematic evaluation of LLM-based solutions.

You will design system prompts, configure routing and knowledge sources, and develop tests to ensure accurate, consistent responses while collaborating with engineering and product teams.

Qualifications

• Hands-on experience with prompt engineering for LLM-based apps.
• Experience configuring and optimizing AI agents.
• Strong understanding of system prompts, context management and few-shot prompting.
• Experience with LLM evaluation and systematic testing of AI outputs.
• Knowledge of tool calling, retrieval-augmented generation (RAG) and structured outputs.
• Ability to analyze LLM responses and implement improvements.
• Experience with API requests, tool results and conversation traces.
• Professional working proficiency in English.

Responsibilities

• Design, develop and maintain system prompts, agent instructions and reusable prompt components.
• Configure AI agents, including routing, handover logic, knowledge sources and tool usage.
• Optimize LLM behaviour for accurate, consistent responses.
• Define how AI agents handle ambiguous requests and missing information.
• Design evaluation datasets, test scenarios and scoring criteria.
• Analyze conversation traces and evaluation results to identify issues and improve performance.
• Test and compare prompt and model changes to measure impact on quality.
• Develop regression test cases to ensure consistent behavior over time.
• Collaborate with engineering, product and business teams to translate requirements into reliable AI solutions.
• Document prompt changes, experiments and evaluation results.

Skills

Prompt engineering

LLM configuration

Evaluate outputs

Context management

API requests

Tool calling

Python scripting

English proficiency

Tools

LangChain

Git

JSON schemas

Job description

Ableneo is seeking a Senior Prompt Engineer (M/F) for our banking sector client. You will shape and optimize AI agents used in conversational applications, focusing on prompt development, agent configuration and systematic evaluation of LLM-based solutions.

You will design system prompts, configure routing and knowledge sources, and develop tests to ensure accurate, consistent responses while collaborating with engineering and product teams.