Overview
QA Engineer (EST hours) – AgileEngine. AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and trailblazing startups across 17+ industries. We rank among the leaders in application development and AI/ML, and our people-first culture has earned Best Place to Work awards.
Why join us: If you're looking for a place to grow, make an impact, and work with people who care, we'd love to meet you!
What you will do
- Design and execute both automated and manual end-to-end test strategies across all layers of the testing pyramid
- Validate AI model performance, including accuracy, confidence thresholds, and fallback behavior
- Automate quality processes from data ingestion to extraction and classification, focusing on speed, repeatability, and resilience
- Test and validate integration points between AI components and core business logic
- Support and enhance CI/CD pipelines by maintaining test infrastructure and defining quality gates, automated scripts, and synthetic data
- Define and track quality metrics that matter to the business (e.g., turnaround time, confidence scores, correction rates)
- Stay on the cutting edge—continuously learn and apply the latest AI and QA practices
Must have
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience
- 3+ years of experience in QA, Test Engineering, or related roles with a strong grasp of QA methodologies
- Solid understanding of SDLC, Agile methodologies, and software quality principles
- Hands-on experience with automation frameworks like Pytest, Selenium, Cypress, Postman
- Comfortable working with REST APIs, data pipelines, and backend services
- Familiarity with cloud platforms (AWS or Azure) and CI/CD tools
- Detail-oriented mindset with a sharp eye for edge cases and a strong sense of ownership
- Quick, proactive learner—especially important in the fast-evolving world of AI
- Upper-Intermediate English level
Nice to have
- Experience testing AI/ML systems in production environments
- Familiarity with GenAI model evaluation metrics
- Experience setting up monitoring/alerting for model drift, workflow failures, or performance issues
Perks and Benefits
- Professional growth: Accelerate your professional journey with mentorship, TechTalks, and personalized growth roadmaps
- Competitive compensation: We match your ever-growing skills with competitive USD-based compensation and budgets for education, fitness, and team activities
- A selection of exciting projects: Work on projects with modern solutions and top-tier clients including Fortune 500 enterprises
- Flextime: Flexible schedule with options to work from home or office
Location & Status
- Seniority level: Mid-Senior level
- Employment type: Full-time
- Industry: IT Services and IT Consulting
Referrals increase your chances of interviewing at AgileEngine.
Get notified about new Quality Assurance Engineer jobs in Greater Porto Alegre.