AI QUALITY ASSURANCE ENGINEER

Svitla Systems, Inc.; Ontario (CA); Remote; USD 80,000 - 120,000; Full time

Job summary

A leading technology solutions provider is looking for an AI Quality Assurance Engineer to join their remote team. In this role, you will ensure the quality of AI features through comprehensive testing and strategic improvements. Ideal candidates have experience in software testing, particularly in AI, strong analytical skills, and a passion for enhancing product quality.

Benefits

20 vacation days

10 national holidays

5 paid sick leaves

Competitive compensation

Flexible working hours

Qualifications

• 5+ years of software testing experience in AI cloud-based SaaS solutions.
• Experience with backend and API testing.
• Familiarity with CI/CD environments and cloud platforms is advantageous.

Responsibilities

• Lead all testing activities, ensuring comprehensive quality assurance.
• Execute functional, non-functional, and regression testing.
• Collaborate with the development team and product management.

Skills

Manual Testing

Automated Testing

Analytical Skills

Problem-Solving

Communication Skills

Education

Bachelor of Science Degree

Tools

Postman

Pytest

Job description

Svitla Systems Inc. is looking for an AI Quality Assurance Engineer for a full-time position (40 hours per week) in Bulgaria. Our client is a leading provider of video analysis solutions for loss prevention and security. It offers a cloud-based platform that acts as a hub to analyze the video stream to find the key points of data and create alerts and reports. It provides motion alerts by detecting unusual motion by setting regions of the camera views, and provides alerts when activity happens. It offers a wide range of tools to keep track of important events and history and identify outlying patterns and incidents. The subscription-based software connects the camera footage with the POS data to review all POS transactions. It pairs them with the corresponding real-time video, creating a dashboard of searchable moments. These moments allow filtering by specific incidents like movement in a room, particular purchases, and unusual staff behavior. The company is headquartered in Ottawa, Ontario, with regional representation worldwide, and serves the retail, banking, and restaurant industries.

We are seeking a skilled QA Engineer with a strong background in both manual and automated testing, ideally in the AI space for cloud-based SaaS solutions. This is a hands-on role within a cross-functional AI product team, working closely with ML engineers, data scientists, and developers to ensure product quality across all areas of development.

You’ll work alongside the Development AI Team and other QA team members, where you can shape and implement the technology and product deliverables to drive the product forward. Your primary focus will be testing new and existing AI features, creating and maintaining test plans for the AI Team, and ensuring high quality throughout the development lifecycle. As gatekeepers of quality, you will increase test coverage, optimize testing with strategic approaches, and proactively identify and mitigate quality risks to deliver a reliable product to the customers.

Overlap until 7–8 PM Bulgarian time.

Requirements

• 5+ years of software testing experience, ideally in the AI space for cloud-based SaaS solutions.
• Experience with backend and API testing, including proficiency with test tools such as Postman (manual) and Pytest (automated).
• Proven ability to create, update, and review detailed test plans and strategies.
• Demonstrate experience leading tests independently, planning and estimating timelines, and being actively involved in development lifecycle discussions
• Strong work ethic with a Positive attitude and a Passion for Quality Assurance.
• You Thrive at solving problems and enjoy a good challenge, including troubleshooting AI-related testing nuances.
• Team Player with Excellent interpersonal and communication skills (written and verbal), working closely with ML engineers, data scientists, developers, and product managers.
• Strong analytical skills and attention to detail.
• Demonstrates a “can do” attitude and takes ownership of tasks and responsibilities.
• Interest in learning new tools and adapting to new technologies or methodologies.
• Bachelor of Science Degree or higher education (Computer Science or related field is an asset).

Nice to have

• Familiarity with CI/CD environments and cloud platforms (e.g., AWS).
• Automated test development experience is a strong asset, especially using Python, Playwright, and Pytest.
• Familiarity and understanding of machine learning concepts, AI pipelines, and integrations between AI components and broader systems is a significant advantage; prior testing experience in MLOps or interest in AI beyond mainstream tools is highly valued.

Responsibilities

• Proactively lead all testing activities within the AI team, ensuring comprehensive test coverage and quality assurance.
• Execute manual and automated functional, non-functional, and regression testing for front and backend components.
• Validate that AI models produce accurate, reliable, and unbiased results by testing various edge cases and diverse datasets.
• Identify, design, and execute comprehensive test coverage plans, including end-to-end (E2E) tests across environments.
• Define and drive the AI team’s automation strategy, including identifying what to automate and how to integrate automated tests into CI/CD pipelines.
• Collaborate closely with the development team and product management to understand upcoming features, create test cases, and provide input to uphold quality in the development lifecycle.
• Identify, report, and verify defects while proactively managing QA risks and the mitigation plan.
• Develop deep expertise in the SaaS platform, viewing it from the perspectives of customers, internal support teams, and customer success managers who set up accounts.
• Provide technical guidance to junior QA team members, helping them understand AI-specific testing methodologies.
• To identify potential issues, perform creative, exploratory testing, think outside the box, and employ unpredictable methods.
• Continuously improve QA processes to enhance efficiency, coverage, and effectiveness.

We offer

• US and EU projects based on advanced technologies.
• Well-established remote culture and flexible working hours.
• No trial period.
• Competitive compensation in USD gross based on skills and experience.
• B2B contract with Svitla Systems Inc. (US legal entity).
• 20 vacation days, 10 national holidays, and 5 paid sick leaves.
• Personalized learning program tailored to your interests and skill development.
• 3 additional days of paid vacation for special life events (marriage, childbirth, etc).
• Bonuses for article writing, public talks, and other activities.
• Free webinars, meetups, and conferences organized by Svitla.
• Awesome team, friendly and supportive community!

About Svitla

Svitla Systems is a global digital solutions company headquartered in California, with business and development offices throughout the US, Latin America, Europe, and Asia. Svitla is an outspoken advocate of workplace flexibility, best known for its well-established remote culture, individual approach to our teammate’s professional and personal growth, and trustworthy environment.

Since 2003, Svitla has served a wide range of clients, from innovative start-ups in California to mega-large corporations such as Ingenico, Amplience, InvoiceASAP and Global Citizen. At Svitla, developers work with clients’ teams directly, building lasting and successful partnerships, as a result of seamless integration with on-site processes.

Svitla Systems’ global mission is to build a business that contributes to the well-being of our partners, personnel and their families, improves our communities, and makes a lasting difference in the world. Join us!

If you are interested in our vacancy, please send your CV.
We will be happy to see you in our friendly team :)

Tell us briefly about your project, and we will contact you within a day.

First Name Last Name Email Country Phone Number Linkedin Profile Link (Optional) Attach Cover Letter (optional) Choose a file or drag and drop ithere (Pdf, max file size 10MB) Attach Resume Choose a file or drag and drop ithere (Pdf, max file size 10MB) or Send me information about vacancy or Svitla news by email (Optional) By submitting the form, you agree to the processing of your personal data. Svitla Privacy Policy Recaptcha requires verification. I'm not a robot reCAPTCHA Privacy - Terms