QA Tester / QA Developer

KVB Trading (Hong Kong) Limited; Hong Kong Island; On-site; HKD 600,000 - 900,000; Full time

Job summary

KVB Trading (Hong Kong) Limited is seeking a QA Automation Engineer to build robust testing infra for real-time financial transactions, AI model safety, and API contracts. You will design evaluation harnesses for LLMs, ensure secure, compliant testing practices, and integrate tests into CI/CD for scalable fintech delivery.

The role focuses on end-to-end automation, AI agent workflows, and performance testing across REST/GraphQL APIs, microservices, and distributed ledgers in a fast-paced fintech

Qualifications

• 4+ years in Test Automation / SDET roles, with fintech or high-compliance environments.
• Hands-on experience evaluating GenAI models or agentic workflows (using frameworks like DeepEval, Ragas, Promptfoo, or custom Python eval scripts).
• API automation and system testing using Postman, Requests, Playwright API, schema/contract validation, and asynchronous event testing (Kafka, RabbitMQ, WebSockets).
• CI/CD pipelines and cloud environments (Docker, AWS/GCP).
• Strong focus on edge cases, numerical precision, and race conditions in financial logic.

Responsibilities

• AI & LLM System Evaluation: design, implement, and maintain evaluation harnesses to measure accuracy, grounding, hallucination rates, and safety across AI features.
• Fintech Core & API Test Automation: build scalable automated test suites for REST/GraphQL APIs, microservices, and distributed ledgers; verify balance calculations, ledgers, and transaction flows.
• E2E & Infrastructure Integration: develop scalable E2E automation frameworks using Playwright, Cypress, or PyTest; integrate into CI/CD; perform load, stress, and latency testing of critical paths.

Skills

Test Automation

Fintech Testing

AI/LLM Testing

API Testing

CI/CD

Cloud (AWS/GCP)

Security & Compliance

Tools

Playwright

Cypress

PyTest

Postman

Kafka

RabbitMQ

WebSockets

Docker

GitHub Actions

Job description

We are building the future of finance, an AI-native fintech platform that leverages large language models (LLMs) and autonomous agents to re-imagine financial services. Financial systems require extreme precision, low latency, and uncompromised compliance. We are seeking a QA Automation Engineer who can build robust testing infrastructures capable of validating both deterministic core financial engines and non-deterministic AI agentic behaviors.

The Role

In this position, you won't just write basic UI scripts or API assertion checks. You will write test cases that evaluates real-time financial transactions, complex API contracts, and the safety, accuracy, and performance of our AI models and workflows.

Core Responsibilities

1. AI & LLM System Evaluation
   • Design, implement, and maintain LLM evaluation harnesses to measure output accuracy, factual grounding, hallucination rates, and safety guardrails across our AI features.
   • Test agentic workflows for proper tool calling, multi-step financial reasoning, and fallback behaviors.
   • Execute regression testing strategies for model upgrades, prompt changes, and system prompt iterations.
2. Fintech Core & API Test Automation
   • Build and scale automated test suites for REST/GraphQL APIs, microservices, and distributed ledgers.
   • Create deterministic data assertion checks for balance calculations, double-entry ledgers, interest routines, and transaction pipelines.
   • Ensure strict adherence to security protocols (OAuth2, mTLS, encryption, PII masking) and regulatory standards (PCI-DSS, SOC 2, KYC/AML).
3. E2E & Infrastructure Integration
   • Build scalable E2E automation frameworks using Playwright, Cypress, or Python (PyTest) integrated into modern CI/CD pipelines.
   • Implement synthetic data generation strategies to safely mimic realistic financial customer interactions without using production PII.
   • Conduct load, stress, and latency testing on critical financial execution paths.

Key Requirements

• Experience: 4+ years in Test Automation / SDET roles, with at least 1–2 years working in Fintech or high-compliance environments.
• AI/LLM Testing: Hands-on experience evaluating GenAI models or agentic workflows (using frameworks like DeepEval, Ragas, Promptfoo, or custom Python eval scripts).
• API & System Testing: Expertise in API automation (Postman, Requests, Playwright API), schema/contract validation, and asynchronous event testing (Kafka, RabbitMQ, WebSockets).
• CI/CD & Cloud: Deep understanding of Docker, GitHub Actions / GitLab CI, and AWS/GCP cloud environments.
• Fintech Mindset: Obsession with edge cases, edge-value numerical precision, and race conditions in financial logic.

Your application will include the following questions:

• Which of the following statements best describes your right to work in Hong Kong?
• What's your expected monthly basic salary?
• What is your highest level of education?
• Do you have experience using TypeScript?

Kowloon Bay, Kwun Tong District, HK