We are seeking an IT Automation Test Engineer who combines strong testing and automation experience with the ability to work directly with business users to understand how technology is used in real-world workflows.
This person will partner with end users, product teams, developers, and other technology stakeholders to understand existing processes, identify pain points and testing needs, and develop automated solutions that improve quality, reliability, and efficiency.
The ideal candidate is comfortable moving beyond traditional QA execution. We are looking for someone who is naturally curious, asks strong questions, understands how users interact with applications, and can translate those insights into effective automated tests and technical solutions.
Experience testing AI-powered applications, AI platforms, or generative AI solutions is highly desirable. Candidates who have strong automation experience and a genuine interest in expanding into AI testing are also encouraged to apply.
Key Responsibilities
- Partner directly with end users and business stakeholders to understand workflows, application usage, pain points, and expected system behavior.
- Translate business requirements and real-world user scenarios into test strategies, test cases, and automated test solutions.
- Design, develop, maintain, and execute automated test suites for enterprise applications and platforms.
- Perform functional, regression, integration, API, end-to-end, and exploratory testing.
- Identify opportunities to automate repetitive testing activities and improve overall QA efficiency.
- Test new functionality from both a technical and end-user perspective to ensure solutions work as intended in actual business scenarios.
- Validate integrations and data flows across applications, APIs, and enterprise systems.
- Investigate defects, document findings clearly, and collaborate with developers and product teams through resolution.
- Participate throughout the software development lifecycle, including requirements gathering, design discussions, development, testing, release, and production support.
- Help establish and improve QA automation frameworks, testing standards, and repeatable processes.
- Support testing of AI-enabled applications and platforms, including validation of AI-generated responses, workflows, integrations, accuracy, reliability, and user experience.
- Explore new approaches and tools for automating the testing of AI and emerging technology solutions.
Must-Have Skills
- Professional experience in Quality Assurance, Software Testing, Test Engineering, or Automation Engineering.
- Hands-on experience developing and executing automated tests.
- Experience with modern test automation tools or frameworks such as Playwright, Selenium, Cypress, or similar technologies.
- Experience testing APIs and integrations using tools such as Postman, REST APIs, or comparable technologies.
- Ability to understand business processes and translate end-user workflows into meaningful test scenarios.
- Strong communication skills with the ability to work directly with technical and non-technical end users.
- Experience with functional, regression, integration, and end-to-end testing.
- Strong troubleshooting and analytical skills with the ability to investigate issues across complex systems.
- Experience working in Agile/Scrum software development environments.
- Ability to work collaboratively with developers, product owners, business analysts, and end users.
Nice-to-Have Skills
- Experience testing AI, generative AI, machine learning, chatbot, copilot, or intelligent automation platforms.
- Understanding of the unique challenges associated with AI testing, including response quality, variability, hallucinations, accuracy, safety, and reliability.
- Experience testing applications that integrate with large language models or APIs from platforms such as Azure OpenAI, Microsoft Copilot, or similar technologies.
- Experience with AI evaluation or observability tools and approaches.
- Experience integrating automated testing into CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or similar platforms.
- Experience with SQL and validating application data.
- Experience with Microsoft Azure or other cloud environments.
- Familiarity with Power Platform, enterprise automation, or robotic process automation technologies is a plus.