Job Description
AgileEngine is an Inc. 5000 company that creates award-winning software for Fortune 500 brands and startups across 17+ industries. We are leaders in application development and AI/ML, with a people-first culture recognized by multiple Best Place to Work awards.
WHY JOIN US
If you're seeking growth, impact, and a caring team, we'd love to meet you!
WHAT YOU WILL DO
- Design and implement automated and manual end-to-end test strategies across all testing layers;
- Validate AI model performance, including accuracy, confidence thresholds, and fallback behaviors;
- Automate quality processes from data ingestion to classification, emphasizing speed, repeatability, and resilience;
- Test and validate integration points between AI components and business logic;
- Support and improve CI/CD pipelines by maintaining test infrastructure, quality gates, scripts, and synthetic data;
- Define and monitor key quality metrics relevant to the business;
- Continuously learn and apply latest AI and QA practices to deliver innovative solutions for our customers.
MUST HAVES
- Bachelor’s degree in Computer Science, Engineering, Information Systems, or equivalent experience;
- 3+ years in QA, Test Engineering, or related roles with strong QA methodologies knowledge;
- Understanding of SDLC, Agile, and software quality principles;
- Experience with automation frameworks like Pytest, Selenium, Cypress, Postman;
- Proficiency with REST APIs, data pipelines, and backend services;
- Familiarity with cloud platforms (AWS or Azure) and CI/CD tools;
- Detail-oriented with a focus on edge cases and ownership;
- Quick learner, especially in AI environments;
- Upper-Intermediate English proficiency.
NICE TO HAVES
- Experience testing AI/ML systems in production;
- Knowledge of GenAI model evaluation metrics;
- Experience with monitoring/model drift detection and workflow failure alerts.
PERKS AND BENEFITS
- Professional growth opportunities through mentorship, TechTalks, and personalized roadmaps;
- Competitive compensation aligned with skills and contributions;
- Engagement in exciting projects with Fortune 500 clients and top brands;
- Flexible work arrangements for work-life balance.
Requirements
- Bachelor’s degree in relevant fields or equivalent experience;
- 2-3 years in AQA, Software Test Engineering, with leadership experience;
- Experience with AQA JavaScript and automation frameworks;
- Strong knowledge of SDLC, Agile, and QA best practices;
- Proven ability to develop scalable test automation frameworks;
- Technical skills with REST APIs, data pipelines, backend services, and cloud platforms;
- Exceptional attention to detail and proactive learning mindset;
- Upper-Intermediate English level.