Fintech QA Automation Engineer: AI/LLM & API Testing

KVB Trading (Hong Kong) Limited; Hong Kong Island; On-site; HKD 600,000 - 900,000; Full time

Job summary

KVB Trading (Hong Kong) Limited is seeking a QA Automation Engineer to build robust testing infra for real-time financial transactions, AI model safety, and API contracts. You will design evaluation harnesses for LLMs, ensure secure, compliant testing practices, and integrate tests into CI/CD for scalable fintech delivery.

The role focuses on end-to-end automation, AI agent workflows, and performance testing across REST/GraphQL APIs, microservices, and distributed ledgers in a fast-paced fintech

Qualifications

• 4+ years in Test Automation / SDET roles, with fintech or high-compliance environments.
• Hands-on experience evaluating GenAI models or agentic workflows (using frameworks like DeepEval, Ragas, Promptfoo, or custom Python eval scripts).
• API automation and system testing using Postman, Requests, Playwright API, schema/contract validation, and asynchronous event testing (Kafka, RabbitMQ, WebSockets).
• CI/CD pipelines and cloud environments (Docker, AWS/GCP).
• Strong focus on edge cases, numerical precision, and race conditions in financial logic.

Responsibilities

• AI & LLM System Evaluation: design, implement, and maintain evaluation harnesses to measure accuracy, grounding, hallucination rates, and safety across AI features.
• Fintech Core & API Test Automation: build scalable automated test suites for REST/GraphQL APIs, microservices, and distributed ledgers; verify balance calculations, ledgers, and transaction flows.
• E2E & Infrastructure Integration: develop scalable E2E automation frameworks using Playwright, Cypress, or PyTest; integrate into CI/CD; perform load, stress, and latency testing of critical paths.

Skills

Test Automation

Fintech Testing

AI/LLM Testing

API Testing

CI/CD

Cloud (AWS/GCP)

Security & Compliance

Tools

Playwright

Cypress

PyTest

Postman

Kafka

RabbitMQ

WebSockets

Docker

GitHub Actions

Job description

KVB Trading (Hong Kong) Limited is seeking a QA Automation Engineer to build robust testing infra for real-time financial transactions, AI model safety, and API contracts. You will design evaluation harnesses for LLMs, ensure secure, compliant testing practices, and integrate tests into CI/CD for scalable fintech delivery.

The role focuses on end-to-end automation, AI agent workflows, and performance testing across REST/GraphQL APIs, microservices, and distributed ledgers in a fast-paced fintech