Senior AI Developer

Sii Poland; Rzeszów; On-site; PLN 180,000 - 240,000; Full time

Job summary

A leading technology firm in Rzeszów is seeking an experienced Senior AI Engineer to develop advanced RAG systems in the Azure environment. You will work on innovative AI technologies that significantly impact patients' lives while collaborating with an international team. The ideal candidate has over 6 years of experience in AI/ML, particularly with LLM systems. This role offers a dynamic environment, a focus on quality metrics, and a range of attractive benefits.

Benefits

Great Place to Work

Solid financial situation

Contracts with the biggest brands

Centre of internal trainings

Many experts you can learn from

Open and accessible management team

Profit sharing

Passion Sponsorship program

Regular integration events and trips

Comfortable and well‑equipped offices

Medical care

Qualifications

• Minimum 6 years of experience in LLM‑based AI/ML systems.
• Very good knowledge of RAG systems architecture.
• Ability to work with metrics and quality analysis.
• Fluent in Azure AI or Azure ML environment.
• Knowledge of vector databases and embedding approaches.
• Proficiency in prompt creation and mitigation techniques.
• Experience with function calling and integration.
• Knowledge of English at a minimum B2 level.

Responsibilities

• Define quality metrics and build monitoring pipelines.
• Create and maintain benchmark sets from real questions.
• Analyze results and identify error sources.
• Optimize chunking, embedding, and search configurations.
• Improve generation through refining prompts.
• Test advanced RAG techniques.

Skills

Experience with LLM‑based AI/ML systems

Knowledge of RAG systems architecture

Ability to work with metrics

Fluency in Azure AI or Azure ML

Knowledge of vector databases

Proficiency in prompt creation

Experience with function calling

English at B2 level

Job description

Join a project where advanced AI is making a real difference in the lives of patients. We are looking for a Senior AI Engineer to take on a key role in the development of cutting‑edge RAG systems running in the Azure environment. Working with cutting‑edge technologies, having a real impact on the direction of product development, and working in partnership in an international, Scandinavian team await you. If you want to develop LLM systems at the highest level and participate in projects with high social value, this is the place for you.

Job no. 251120-ALR94

Your tasks

• Defining quality metrics (accuracy, hit‑rate, faithfulness, latency) and building monitoring pipelines
• Creating and maintaining benchmark sets based on real questions and golden answers
• Analyzing results and identifying sources of errors: retrieval, hallucinations, prompt problems
• Optimizing chunking, embedding, vector storage and search configurations
• Improving generation by refining prompts, formatting and hallucination mitigation methods
• Improving function calling processes and validating the correctness of calls
• Testing advanced RAG techniques, such as query rewriting and re‑ranking

Requirements

• Minimum 6 years of experience in LLM‑based AI/ML systems
• Very good knowledge of RAG systems architecture and building practices
• Ability to work with metrics, evaluation and quality analysis
• Fluent in Azure AI or Azure ML environment
• Knowledge of vector databases and embedding approaches
• Proficiency in prompt creation and hallucination mitigation techniques
• Experience with function calling and integration with external tools
• Knowledge of English at a minimum B2 level

Benefits For You

• Great Place to Work
• Solid financial situation
• Contracts with the biggest brands
• Centre of internal trainings
• Many experts you can learn from
• Open and accessible management team
• Profit sharing
• Passion Sponsorship program
• Regular integration events and trips
• Comfortable and well‑equipped offices
• MySii app
• Medical care