Software Engineer (AI Security & Quality) - #1633

JOBSTER PRIVATE LTD.; Singapore; On-site; SGD 120,000 - 180,000; Full time

Job summary

JOBSTER PRIVATE LTD. is seeking a security-focused software/AI assurance professional to design and execute AI security assessments for LLM, RAG, and agentic applications.

The role involves implementing Moonshot and Litmus testing, developing test data governance, and advising on secure use of enterprise data in GenAI scenarios. You will review solution designs for security and privacy risks, document findings with remediation guidance, and integrate automated AI security tests into CI/CD

Qualifications

• Experience in software engineering, cybersecurity, application security, AI assurance, SDET, or technical QA automation.

Responsibilities

• Design and execute AI security assessments for LLM, RAG, and agentic apps.
• Implement Moonshot and Litmus testing with baseline and app-specific suites.
• Develop synthetic data for functional, safety, and security evaluation with proper governance.
• Translate policies into testable controls and evidence; advise on secure use of enterprise data in GenAI solutions.
• Review AI solution designs for security and privacy risks; embed security by design.
• Document vulnerabilities with risk, impact, evidence, and remediation guidance; track fixes.
• Integrate automated AI security tests into CI/CD and release processes.
• Build and maintain automated functional, regression, API, and end-to-end tests.
• Defect investigation via logs; provide actionable reports to engineers.
• Promote quality practices and reusable test assets across teams.
• Conduct AI red-team exercises, threat modelling, and governance reviews.

Skills

AI Security Testing

Moonshot & Litmus

AI Evaluation & Data Governance

Security Compliance & Risk Advisory

Solution Architecture

Security Automation

Test Automation

Python & JS/TS

Cloud & Data Security

Tools

Moonshot

Litmus

Pytest

Playwright

Job description

Core Responsibilities (AI Security, Compliance & Architecture):

· AI Security Testing: Design and execute AI-specific security and safety assessments for LLM, RAG, and agentic applications, covering threats such as prompt injection, jailbreaks, sensitive-data disclosure, insecure output handling, excessive agency, tool misuse, and cross-tenant data exposure. Conventional application penetration testing is performed by third-party providers and is outside the primary scope of this role.

· Moonshot & Litmus Implementation: Implement and operationalise Moonshot and Litmus testing across relevant AI use cases. Configure baseline and application-specific test suites, curate adversarial scenarios, analyse results, and establish repeatable evidence for assurance reviews.

· AI Evaluation & Test Data Governance: Develop representative test datasets and securely generate synthetic data for functional, safety, and security evaluation. Ensure test data is appropriately classified, masked, anonymised, retained, and disposed of in accordance with applicable policies.

· Compliance, Assurance & Risk Advisory: Translate organisational policies, government security requirements, and AI governance expectations into testable controls and evidence. Advise internal stakeholders on secure use of enterprise and sensitive data in GenAI solutions, including data flows, access controls, tenant isolation, retrieval boundaries, logging, retention, model or service selection, and third-party integration risks. Support risk assessments, security reviews, audit responses, remediation plans, and go-live assurance activities.

Secure Solution Architecture: Review proposed AI solution designs, identify security and privacy risks, recommend proportionate controls, and collaborate with engineering and architecture teams to embed security by design throughout the solution lifecycle.

Security Findings, Remediation & Reporting: Document vulnerabilities and control gaps with clear risk, impact, evidence, and remediation guidance. Work with delivery teams to track and validate fixes, communicate residual risk to technical and non-technical stakeholders, and report assurance metrics, recurring findings, and risk trends.

Security Automation & Release Assurance: Integrate automated AI security and evaluation tests into CI/CD pipelines and release processes. Define security regression checks, release gates, and acceptance criteria to identify material risks before production deployment.

Secondary Responsibilities (Software Test Automation):

· Test Automation: Build and maintain automated functional, regression, API, and end-to-end tests using suitable frameworks such as Pytest, Playwright, Cypress, or Postman.

· Defect Investigation: Reproduce issues, trace application and cloud logs, isolate root causes, and provide actionable defect reports to engineering teams.

· Quality Enablement: Promote pragmatic testing practices, reusable test assets, and shared ownership of quality across product and engineering teams.

Qualifications:

· Experience: Relevant experience in software engineering, cybersecurity, application security, AI assurance, SDET, or technical QA automation.

· AI Security Knowledge: Practical understanding of security and safety risks affecting LLM, RAG, and agentic applications, including prompt injection, data leakage, unsafe tool use, excessive permissions, insecure output handling, and model or application abuse.

· AI Testing Toolkits: Hands-on experience with Moonshot, Litmus, or comparable AI evaluation, red‑team­ing, benchmarking, or adversarial‑testing tools; ability to design custom scenarios and interpret results.

· Security & Compliance: Ability to interpret security, privacy, and AI governance requirements and translate them into technical controls, test plans, risk assessments, and assurance evidence.

· Solution Architecture: Experience reviewing system designs and data flows, assessing trust boundaries and integration risks, and recommending secure, proportionate architectures for cloud‑based applications.

· Stakeholder Consulting: Strong communication and facilitation skills, with the ability to explain technical risks, challenge assumptions constructively, and guide internal stakeholders towards secure implementation decisions.

· Coding & Automation: Proficiency in Python and working knowledge of TypeScript or JavaScript, with experience in automated API, functional, regression, or end‑to‑end testing.

· Cloud & Data: Familiarity with AWS services, containerised environments, SQL databases, access controls, logging, encryption, data classification, masking, retention, and secure handling of sensitive information.

Preferred Qualifications:

· Experience conducting AI red‑team exercises, AI threat modelling, or AI security and application assurance reviews.

· Familiarity with recognised AI and application security guidance, such as the OWASP GenAI Security Project, NIST AI Risk Management Framework, or MITRE ATLAS.

· Experience testing RAG pipelines, model integrations, agent tools, sandboxes, RBAC, tenant‑isolation controls, and other AI‑specific attack surfaces.

· Familiarity with government enterprise environments and high‑security data compliance requirements, including IM8.