Senior AI QA Automation Engineer (Remote)

Jobgether SRL; Italia; In loco; EUR 55.000 - 85.000; Tempo pieno

Descrizione del lavoro

Jobgether in Italy is seeking a Senior QA Automation Engineer – AI Applications to help ensure the quality of next-generation AI-powered products.

You will design and scale automated test suites for APIs, models, and user-facing features, and evaluate AI/ML outputs with rigorous quality gates. This role emphasizes automation, CI/CD integration, cross-team collaboration, and opportunities to influence product reliability in a remote/hybrid setup.

Competenze

• Bachelor's degree in Computer Science, Engineering, or equivalent practical experience.
• 5+ years of experience in software QA, test automation, or software engineering roles.
• Strong programming skills in Python with hands-on experience building test automation frameworks.
• Experience working with CI/CD systems and modern development workflows.
• Practical use of AI-powered tools or coding assistants to enhance testing productivity and automation quality.
• Solid understanding of software architecture, design patterns, and scalable system design.
• Experience designing QA frameworks or platforms used across multiple teams or services.
• Strong analytical thinking, problem-solving ability, and attention to detail.
• Excellent communication and collaboration skills in Agile, distributed environments.
• Nice to have: experience testing AI/ML systems, validating models, or working with tools such as PyTorch or TensorFlow.
• Nice to have: familiarity with MLOps practices, data pipelines, or tools such as Apache Airflow, MLflow, or cloud platforms (AWS, Azure, GCP).

Mansioni

• Design, build, and maintain automated test suites, evaluation scenarios, datasets, and metrics for AI-powered features and systems.
• Develop scalable QA automation frameworks and test harnesses for APIs, backend services, and AI applications using Python.
• Automate QA workflows within CI/CD pipelines (e.g., GitHub Actions, Jenkins), integrating AI-assisted testing tools to improve coverage and efficiency.
• Define QA strategy, test plans, and acceptance criteria across functional, integration, API, and AI/ML-specific testing domains.
• Evaluate AI/ML model outputs for correctness, consistency, bias, and expected product behavior using structured rubrics and measurable quality gates.
• Build and maintain automated regression and validation pipelines embedded in deployment workflows.
• Participate in cross-team engineering initiatives, code reviews, and ensure QA best practices are consistently applied.
• Document testing strategies, findings, and recommendations, while contributing to knowledge sharing across teams.
• Mentor peers and help elevate QA maturity across engineering teams working on AI-driven systems.

Conoscenze

Python

CI/CD

Test automation

Architecture & design

Analytical thinking

Communication

Agile

Team collaboration

Formazione

Bachelor's degree in Computer Science or related

Strumenti

PyTorch

TensorFlow

Apache Airflow

MLflow

GitHub Actions

Jenkins

Descrizione del lavoro

Jobgether in Italy is seeking a Senior QA Automation Engineer – AI Applications to help ensure the quality of next-generation AI-powered products.

You will design and scale automated test suites for APIs, models, and user-facing features, and evaluate AI/ML outputs with rigorous quality gates. This role emphasizes automation, CI/CD integration, cross-team collaboration, and opportunities to influence product reliability in a remote/hybrid setup.