AI Optimization Engineer for Agentic MVPs

Etraveli Group; Stockholms kommun; Hybrid; SEK 900,000 - 1,300,000; Full time

Benefits offered by this job

Hybrid work model

Modern city office access

Healthcare allowance

Pension and health insurance

Daily breakfast

Job summary

Etraveli Group is seeking a hands-on engineer to fortify its AI Optimization team. You will rapidly build, test, and evaluate agentic MVPs using Python, APIs, and LLM frameworks, with rigorous evaluation pipelines for accuracy, latency, and ROI.

Translate prototypes into actionable specs for scale by the core Technology team. You will be a technical stakeholder, shaping MVPs into production-ready architecture and supporting business stakeholders with prompts and logic.

Qualifications

• 3+ years software engineering experience with strong Python and rapid prototyping skills.
• Hands-on experience with LLM orchestration (tool use, RAG, structured outputs via LangChain, LlamaIndex, LiteLLM, or APIs).
• Proficiency in API design, SQL, and relational/vector databases.
• Experience using evaluation frameworks (Ragas, DeepEval, LangSmith) to benchmark performance.
• Agile, pragmatic mindset for fast experimentation outside traditional sprint cycles.
• Ability to convert complex business logic into concise specs for engineering teams.

Responsibilities

• Build functional end-to-end agents using Python, LLM frameworks, APIs, and databases.
• Spin up infrastructure (vector/relational databases, docker containers) for real-world testing.
• Select architectural patterns (API wrappers, lightweight RAG, function calling).
• Iterate based on business feedback and discard when concepts prove unviable.
• Design evaluation pipelines to benchmark accuracy, hallucination rates, latency, and cost.
• Build ground-truth labeled evaluation sets with business owners to validate production readiness.
• Analyze discrepancies between agent outputs and human decisions during pilots.
• Support business stakeholders in taking responsibility for prompts and business logic.
• Continuously test new AI models and tools against internal benchmarks.
• Serve as the primary technical stakeholder to the core technology AI platform team.
• Translate validated MVPs into clear technical specs, architecture diagrams, and data flows.
• Partner with AI platform team to ensure seamless absorption of MVP logic into internal SDKs.

Skills

Python

Rapid prototyping

LLM orchestration

LangChain

LlamaIndex

LiteLLM

APIs

SQL

Relational databases

Vector databases

Agile

Tools

FastAPI

Docker

Serverless

APIs

Job description

Etraveli Group is seeking a hands-on engineer to fortify its AI Optimization team. You will rapidly build, test, and evaluate agentic MVPs using Python, APIs, and LLM frameworks, with rigorous evaluation pipelines for accuracy, latency, and ROI.

Translate prototypes into actionable specs for scale by the core Technology team. You will be a technical stakeholder, shaping MVPs into production-ready architecture and supporting business stakeholders with prompts and logic.