Remote AI QA Tester

Naukri Mitra; United States; Remote; USD 87,000 - 106,000; Full time

Job summary

Naukri Mitra is hiring a Remote AI QA Tester to help shape the future of AI responsibly from anywhere. You’ll join a remote, expert team ensuring fair, safe, and usable AI across platforms, with collaboration across engineers, product managers, and ethical AI specialists.

The role emphasizes hands-on and automated testing of conversational interfaces, ML models, and NLP systems, with a focus on ethical standards and inclusive design.

Qualifications

• 3+ years of experience in software or AI quality assurance.
• Familiarity with testing conversational interfaces, ML models, or NLP systems.
• Proficiency in writing and executing manual and automated test cases.
• Experience using version control systems like Git.
• A passion for inclusive design and ethical testing standards.

Responsibilities

• Plan and carry out both hands-on and script-driven testing on AI models, ensuring accuracy and ethical compliance.
• Test machine learning features across workflows, platforms, and edge cases.
• Review conversational AI outputs for cultural sensitivity, fairness, and linguistic coherence.
• Log reproducible bugs with clear, inclusive communication to teammates.
• Build scalable test cases using Python or similar scripting languages where automation makes sense.
• Collaborate with data engineers to identify gaps in training datasets or model performance.
• Participate in inclusive QA retrospectives and contribute ideas to foster a high-trust testing environment.

Skills

AI QA

NLP testing

Automation testing

Inclusive design

Tools

Git

Job description

Remote AI QA Tester

Join a Mission-Driven, Inclusive Tech Team from Anywhere

What if your work directly shaped the future of AI, and you could do it from anywhere? Welcome to a team where your curiosity, compassion, and attention to detail fuel something bigger than software. As a Remote AI QA Tester earning $96,359 annually, you’ll be helping ensure the integrity, fairness, and usability of AI systems impacting real people daily. Our journey started with a belief: technology must serve everyone. Since day one, we've embraced diversity—not just in who we hire but in how we build. We champion equity, accessibility, and transparency in everything we create. Here, your perspective matters, your feedback shapes our products, and your growth is part of our mission.

What You’ll Help Build

You’ll be a core member of our remote quality assurance team, working alongside engineers, product managers, and ethical AI specialists to test, refine, and safeguard intelligent systems that power modern platforms. Your contributions ensure our AI behaves responsibly and inclusively - no exceptions.

Key Responsibilities

• Plan and carry out both hands-on and script-driven testing on AI models, ensuring both accuracy and ethical compliance
• Test machine learning features across various workflows, platforms, and edge cases
• Review conversational AI outputs for cultural sensitivity, fairness, and linguistic coherence
• Log reproducible bugs using clear, inclusive communication with technical and non-technical teammates
• Build scalable test cases using Python or similar scripting languages where automation makes sense
• Collaborate with data engineers to identify gaps in training datasets or model performance
• Participate in inclusive QA retrospectives and contribute ideas to foster a high-trust testing environment

Work Environment That Supports You

We are proudly a remote-first company, built around flexibility and collaboration. Whether in a bustling city or a quiet town, your workday is structured around your productivity and peace of mind, not office hours. Here, belonging isn’t a buzzword. Our inclusive workplace prioritizes mental health, flexibility, and empathy. From employee resource groups to well-being stipends, we’ve fostered a culture where individuals of varied backgrounds can succeed.

Expect to work with:

• Cross-functional teams that value your voice and your lived experience
• Inclusive language practices and respectful peer reviews
• Leaders who encourage questions, growth, and autonomy

Tools and Technology

Our tech stack is modern, adaptable, and constantly evolving to meet the demands of AI testing. You’ll work with tools that promote collaboration and efficiency across time zones and cultural contexts.

Some of the tools you might use:

• Jira or Linear for issue tracking
• Postman and Swagger for API validation
• Python, PyTest, and Selenium for automation scripting
• TensorFlow, PyTorch, or custom ML environments for model QA
• Slack and Zoom for asynchronous and live team communication

What We’re Looking For

We believe potential is more than a resume. But if you’re wondering whether this role fits, here’s a helpful guide:

Core Qualifications

• 3+ years of experience in software or AI quality assurance
• Familiarity with testing conversational interfaces, machine learning models, or NLP systems
• Proficiency in writing and executing both manual and automated test cases
• Experience using version control systems like Git
• A passion for inclusive design and a commitment to ethical testing standards

Nice-to-Have Attributes

• Experience working in diverse teams or multicultural environments
• Contributions to open-source QA tools or community-driven testing initiatives
• Understanding of AI safety, bias detection, or responsible machine learning practices

Growth and Development

Joining us means growth in more ways than one. Whether it's internal mentorship, peer-led learning sessions, or access to curated AI ethics and software QA courses, you’ll never be stuck in a professional rut. We regularly promote from within and support lateral moves if you want to explore new areas like product management, data annotation, or AI fairness research. Your growth is our shared priority.

Real Stories, Real Support

When Sam (they/them) joined as a QA tester, they were nervous about speaking up in retros. With mentorship and encouragement, they soon led a testing initiative that improved our chatbot's accuracy by 20%. Their insights are now part of our training materials—and they’re mentoring new hires, just like someone mentored them.

Ready to Build a Better Future with AI?

This isn’t just a testing role—it’s a chance to influence how AI respects, represents, and responds to the world. We want to hear your story if you’re driven by curiosity, compassion, and code.

We’re excited to meet you.

Opportunities Without Borders: Candidates from the USA, Canada, UK, European Union, Australia, India, and several other global regions are encouraged to apply.