AI Quality Assurance & GenAI Operations Engineer

JR Italy; Como; Remoto; EUR 45.000 - 65.000; Tempo pieno

Descrizione del lavoro

A leading technology company seeks an AI Quality Assurance & GenAI Operations Engineer to enhance AI initiatives and manage cloud-native applications. The role involves designing test strategies, maintaining services, and collaborating with teams to deliver reliable AI features. Ideal candidates have experience in software QA, automation, and cloud environments, with strong communication skills in Italian and English.

Servizi

Competitive salary with performance-based bonus

Remote-first culture

Flexible working hours

Annual budget for learning and certifications

Modern equipment plus home office stipend

Competenze

• 2+ years in Software QA, SDET, DevOps, or similar role.
• Practical knowledge of Python for scripting tests.
• Hands-on experience with Docker and cloud providers.

Mansioni

• Design and automate test strategies for LLM workflows.
• Deploy, scale, and troubleshoot GenAI microservices.
• Document test cases and operational playbooks.

Conoscenze

Python

Docker

Linux

Communication

Strumenti

Kubernetes

GitHub Actions

Prometheus

Grafana

Descrizione del lavoro

AI Quality Assurance & GenAI Operations Engineer, como

Client:

altermAInd

Location:

Job Category:

Other

-

EU work permit required:

Yes

Job Reference:

384748714748962406433712

Job Views:

3

Posted:

12.05.2025

Expiry Date:

26.06.2025

Job Description:

Do you want to be part of a technology company with an AI-first approach, shaping the invisible by blending AI innovation with human experience?

altermAInd is a company that offers solutions enabling organizations to overcome limits, uncover hidden opportunities, and drive transformative growth.

Location: Flexible / Remote

About the Role

We are looking for a hands-on engineer (mid-level or senior, depending on experience) who will own both Quality Assurance for our AI initiatives and the day-to-day running of our cloud-native Generative-AI applications. You will design and automate test strategies for large-language-model (LLM) workflows, keep production GenAI services healthy, and contribute improvements using Python, Docker, and modern open-source frameworks such as LlamaIndex and AutoGen.

What will you do?

• AI Quality Assurance
• Create, automate, and execute test plans for LLM pipelines, data ingestion, and RAG (Retrieval- Augmented Generation) solutions.
• Monitor model accuracy, bias, and drift; investigate anomalies and coordinate fixes with data scientists.
• Integrate automated tests into our CI/CD pipelines for continuous validation.
• GenAI Operations & Maintenance
• Deploy, scale, and troubleshoot GenAI microservices packaged in Docker on our cloud-native platform (Kubernetes or managed container services).
• Maintain prompt libraries, embeddings stores, and vector indexes built with LlamaIndex, AutoGen, or similar frameworks.
• Implement observability (logging, metrics, alerting) and incident-response runbooks to keep SLAs on track.
• Partner with ML engineers, product managers, and DevOps teams to ship reliable AI features.
• Document test cases, operational playbooks, and post-incident analyses to build organizational knowledge.

Who are you?

• 2+ years in Software QA, SDET, DevOps, or a similar engineering role (experience with AI/ML systems is a plus).
• Practical knowledge of Python for scripting tests, data checks, or automation tasks.
• Hands-on experience with Docker and at least one major cloud provider (AWS, Azure, or GCP).
• Familiarity with CI/CD tooling (GitHub Actions, GitLab CI, or similar).
• Strong understanding of software testing principles and comfort working in Linux-based, cloud-native environments.
• Clear communication skills in Italian, both written and spoken.
• Good knowledge of English.

Preferred (Nice-to-Have)

• Direct experience with LLM orchestration frameworks (LlamaIndex, AutoGen, LangChain).
• Kubernetes (EKS, AKS, GKE, or vanilla K8s) for container orchestration.
• Observability stacks such as Prometheus/Grafana, OpenTelemetry, or Datadog.
• Knowledge of vector databases (e.g., Pinecone, Weaviate) and embedding techniques.
• ISTQB, AWS DevOps, or other relevant certifications.

What do we offer?

• Competitive salary with performance-based bonus.
• Remote-first culture and flexible working hours.
• Annual budget for learning, certifications, and conferences in AI/ML and DevOps.
• Modern equipment plus a stipend for your home office.
• The chance to shape production GenAI systems from the ground up in a fast-growing company.

Please note that if you are NOT a passport holder of the country for the vacancy you might need a work permit. Check our Blog for more information.

Bank or payment details should not be provided when applying for a job. Eurojobs.com is not responsible for any external website content. All applications should be made via the 'Apply now' button.