AI Platform Engineer: LLM Production & Ops (Hybrid/Remote)

Qualifyze; Barcelona; Hybrid; EUR 50,000 - 60,000; Full time

Benefits offered by this job

Hybrid working mode

Personal budget for development

Private health care

Meal allowances

All-company events in Europe

3 months remote work

Job summary

Qualifyze, founded in 2019, is a leading supplier-chain compliance company in Life Sciences. We are seeking an AI Engineer to join our Engineering team and bring AI solutions from prototype to production.

You will own AI solutions across their lifecycle, including architecture, deployment, monitoring and cost optimization. You will design and deploy production-ready LLM apps, evaluate models and manage cloud infrastructure with IaC.

Qualifications

• 4+ years in software/ML engineering or related field.
• 2+ years building and deploying LLM-based systems in production.
• Strong Python and backend API development experience.
• Experience with LLM solutions and techniques like RAG, embeddings, vector databases, and agent orchestration.
• Experience with cloud platforms (AWS/GCP) and their AI services.
• Practical experience with Docker, Kubernetes, CI/CD, and Infrastructure as Code (Terraform).
• Experience monitoring and operating AI/ML systems in production.
• Ability to communicate technical decisions clearly to both engineers and business stakeholders.
• Experience in regulated industries (pharma, life sciences, healthcare, or fintech) is a plus.
• Familiarity with LLM evaluation tools and LLMOps platforms is a plus.

Responsibilities

• Design, develop and deploy production-ready LLM applications, including RAG pipelines, agents and workflow automation.
• Evaluate and select models, frameworks and providers based on use case requirements.
• Develop evaluation processes to measure AI quality, reliability and regressions.
• Design and manage cloud infrastructure for AI workloads using AWS/Azure/GCP and IaC.
• Build and maintain CI/CD pipelines for models, prompts and AI services with automated testing and controlled releases.
• Deploy and scale AI services using containers and orchestration tools (Docker, Kubernetes).
• Implement monitoring and observability for AI systems (tracing, latency, drift).
• Establish usage controls and optimize costs via model selection, caching and batching.
• Investigate and resolve production issues across the AI stack.
• Stay updated with AI developments and identify practical tools for value.

Skills

Python

LLM experience

API development

Model evaluation

Cloud platforms

RAG/Embeddings

CI/CD

Infra as Code

Communication

AI governance

Education

4+ years in software/ML eng or related

Tools

Docker

Kubernetes

Terraform

AWS SageMaker / Vertex AI

MLflow / Langfuse

Vector DBs

OpenAI API

Job description

Qualifyze, founded in 2019, is a leading supplier-chain compliance company in Life Sciences. We are seeking an AI Engineer to join our Engineering team and bring AI solutions from prototype to production.

You will own AI solutions across their lifecycle, including architecture, deployment, monitoring and cost optimization. You will design and deploy production-ready LLM apps, evaluate models and manage cloud infrastructure with IaC.