Description
Trintech is an award-winning AI-driven Fintech SaaS organisation transforming the way finance teams operate.
Our Software Test Automation Lead serves as a hands-on individual contributor responsible for defining test automation standards and advancing quality assurance practices across Trintech’s AI Platform.
This role owns test automation for core platform services, including multi-tenant architecture, IAM and OAuth workflows, event-driven services, API gateway functionality, billing and metering capabilities, audit trails, and the agent marketplace.
Working closely with Platform Engineering, QA engineers, Architecture, and Agent Stream teams, the Software Test Automation Lead designs scalable test strategies, builds and maintains automated test suites, integrates quality gates into CI/CD pipelines, and ensures platform capabilities are secure, reliable, testable, and production-ready.
This role also provides practice leadership across agent development squads by establishing QA standards, improving LLM and agent testing approaches, mentoring through technical example, and driving consistent test framework design, automation quality, and continuous improvement without direct people management.
WHAT YOU WILL DO
The essential functions include, but are not limited to the following:
- Platform Team Quality Assurance
- QA Practice Leadership Across Agent Stream
- Quality Standards & Engineering Craft
WHO YOU ARE
- 7+ years of software testing and test automation experience, with strong experience in SaaS platform, backend services, or enterprise application testing.
- Strong experience designing, building, and maintaining automated test frameworks using Pytest, Playwright, Selenium, or similar tools, including framework architecture, reusable components, and test code quality standards.
- Strong Python experience for test framework development, custom assertions, API validation, and automated testing support.
- Experience with REST API testing, contract testing, schema validation, and tools such as Postman, HTTPX, or similar platforms.
- Experience integrating automated test suites into CI/CD pipelines, including test reporting, pipeline definition, and automated quality gate enforcement using Azure DevOps or similar tools.
- Experience with SQL and NoSQL databases for test data management, teardown, and database state validation.
- Experience testing multi-tenant SaaS systems, including tenant isolation, cross-tenant security boundaries, and scoped data access.
- Experience testing event-driven systems, including message ordering, delivery guarantees, idempotency, and event schema validation.
- Experience with API gateway testing, OpenAPI schema validation, versioning, rate limiting, and inter-service contract testing.
- Experience testing IAM and authentication workflows, including OAuth 2.0, token lifecycle validation, and identity propagation across services.
- Experience validating audit trails, immutable logs, correlation ID chains, and event emissions for compliance-grade platform services.
- Experience defining QA standards, test framework conventions, coverage expectations, or quality gate patterns across multiple teams or squads.
- Demonstrated ability to raise QA capability through mentoring, framework contributions, standards documentation, or introduction of improved testing practices.
- Understanding of LLM and agent testing concepts, including non-deterministic outputs, multi-step agent workflows, confidence-based validation, and evolving AI testing practices.
- Familiarity with Langfuse or equivalent LLM observability tools and their use in agent validation.
- Strong communication, collaboration, technical leadership, problem-solving, and continuous improvement skills.
- Hands-on experience with Langfuse, including trace validation, evaluation pipeline setup, or confidence score assertion preferred.
- Experience with LLM evaluation frameworks, such as Ragas or equivalent tools for RAG output quality testing preferred.
- Experience with performance or load testing for API or LLM inference endpoints preferred.
- Experience with Azure Monitor, Application Insights, or similar tools for observability-assisted debugging preferred.
- Contributions to open-source test tooling or automation frameworks preferred.
- Prior formal or informal QA leadership experience, such as tech lead, QA chapter lead, or equivalent preferred.
At our core, Trintechers stand committed to fostering a culture rooted in our core values – Humble, Empowered, Reliable, and Open. Together, these values guide our actions, define our identity, and inspire us to continuously strive for excellence in everything we do.
All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin or disability.