AI Platform Engineer

Qualifyze GmbH; United States; Hybrid; USD 56,000 - 67,000; Full time

Benefits offered by this job

Hybrid working mode

Annual personal development budget

Private health care

Work from anywhere up to 3 months per‑

Annual all-company event

Job summary

Qualifyze is hiring an AI Engineer to join the Engineering team to move AI solutions from prototype to production. You will design and deploy LLM-based apps, build infra, and optimize costs across the lifecycle. You will also help establish best practices for AI development and governance.

You will work with AWS/GCP, Docker/Kubernetes, and modern MLOps tools to deliver reliable AI services and contribute to scalable AI capabilities across the organization.

Qualifications

• 4+ years of experience in software/ML engineering or MLOps, incl. 2+ years deploying LLMs.
• Strong Python skills and production API development experience.
• Hands-on with LLM solutions, embeddings, vector DBs and agent orchestration.
• Experience with cloud AI services (AWS/GCP) and Terraform or similar IaC.
• Experience monitoring AI/ML systems in production.

Responsibilities

• Design, develop and deploy production-ready LLM apps with RAG pipelines and agents.
• Evaluate models/frameworks and choose based on use case needs.
• Build CI/CD and deploy AI services with containers and orchestration.
• Manage cloud infra for AI workloads using IaC and cloud AI services.
• Establish observability, performance and cost controls for AI systems.

Skills

Python

LLM deployment

Backend APIs

Tools

Docker

Kubernetes

Terraform

AWS

GCP

Bedrock

SageMaker

Vertex AI

Langfuse

MLflow

Job description

About Qualifyze,

Founded in 2019, Qualifyze is a leading company in supply chain compliance management in the Life Sciences industry, trusted by over 1,500 pharmaceutical and healthcare companies globally. Our digital suite of solutions connects manufacturers, suppliers, and a global network of more than 250 auditors and quality experts.

With a track record of over 4,500 audits across 85+ countries and the largest and most accurate supplier network and data analytics tools, Qualifyze stands as the all-in-one partner for quality compliance and supply chain risk mitigation in the Life Sciences sector.

Role Overview

We are looking for an AI Engineer to join our Engineering team.

You will help bring AI solutions from prototype to production, building the systems, infrastructure and deployment processes behind our LLM-based and agentic applications. You will take ownership of AI solutions across their lifecycle, from architecture and development to deployment, monitoring and cost optimisation. You will also contribute to the technical practices that support AI development across the organisation.

Main responsibilities

• Design, develop and deploy production-ready LLM applications, including RAG pipelines, agents and workflow automation.
• Evaluate and select suitable models, frameworks and providers (e.g. OpenAI, Anthropic, Mistral and open-source alternatives) based on the requirements of each use case.
• Develop evaluation processes and benchmarks to measure AI quality, reliability and potential regressions before and after release.
• Design and manage cloud infrastructure for AI workloads using platforms such as AWS, Azure or GCP and Infrastructure as Code.
• Build and maintain CI/CD pipelines for models, prompts and AI services, including automated testing, controlled releases and rollback processes.
• Deploy and scale AI services using containers and orchestration tools such as Docker, Kubernetes or equivalent managed solutions.
• Implement monitoring and observability for AI systems, covering tracing, latency, output quality, drift and potential failure points.
• Establish usage controls and optimise costs through model selection, caching and batching.
• Investigate and resolve production issues across the AI stack.
• Keep up to date with developments in AI and identify techniques and tools that can bring practical value.

Main requirements

• 4+ years of experience in software engineering, ML engineering or MLOps/platform engineering, including 2+ years building and deploying LLM-based systems in production.
• Strong Python skills and experience developing production APIs and backend services.
• Practical experience with LLM solutions (e.g. OpenAI, Anthropic, Mistral or similar) and techniques such as RAG, embeddings, vector databases and agent orchestration.
• Experience with cloud platforms such as AWS or GCP and their AI services (e.g. Bedrock, SageMaker or Vertex AI).
• Practical experience with Docker, Kubernetes or equivalent technologies, CI/CD and Infrastructure as Code (e.g. Terraform or similar).
• Experience monitoring and operating AI or ML systems in production.
• Ability to communicate technical decisions clearly to engineering teams and business stakeholders.
• A structured and pragmatic approach to problem-solving, with a sense of ownership.
• Experience in regulated industries such as pharma, life sciences, healthcare or fintech is a plus.
• Familiarity with LLM evaluation tools and LLMOps platforms (e.g. Langfuse or MLflow) is a plus.
• Knowledge of AI governance, regulatory frameworks and IT security standards (e.g. EU AI Act, ISO 42001 and ISO 27001) is a plus.
• Experience developing internal tools or supporting developer enablement initiatives is a plus.
• Experience with agentic coding is a plus.

Salary

At Qualifyze, our salary ranges are transparent internally, and we aim to follow a similar approach externally. For this role, we’re happy to share a reference point within the band: the expected salary range is around 50,000 – 60,000 €, centered around the median.

Final compensation will depend on experience and performance during the process, with some flexibility within the range.

What do we offer?

• Competitive, annually reviewed compensation package
• Country vacation package that increases with your tenure
• Country-specific benefits offering incl. private health care, fitness and meal allowances
• Annual personal development budget to increase your impact
• Hybrid working mode, plus up to 3 months of the year work from anywhere.
• All the best kit and tools to work effectively
• Annual in-person all-company event and celebration in Europe
• Working with an exceptional team, doing some of the best work of your career

Use of AI in Our Recruitment Process

We believe in a human-led hiring process. All applications are reviewed manually by our Talent Acquisition team, and neither Talent Acquisition nor Hiring Managers use AI to screen, filter, rank, assess, or make decisions about candidates, including during interviews and assessments. During interviews, AI may be used only to support note-taking and transcription.

All hiring decisions are made by people!

Diversity & Inclusion at Qualifyze

At Qualifyze, we actively support the power of diversity, uniting complementary talents and perspectives to address new challenges. Our collective strengths help us find innovative solutions and turn difficulties into opportunities. We encourage you to bring your authentic self to work, fostering an inclusive environment where everyone belongs and feels heard.

We are an equal opportunity employer and welcome applications from candidates of all backgrounds, regardless of race, ethnicity, gender identity, sexual orientation, marital status, religion, disability, or age. Our hiring practices are rooted in fairness and respect, and we strive to create a culture where everyone feels valued and empowered.