# IMDA/AI Verify Starter Kit for Testing Agentic Systems: Starter Kit for Testing Agentic Systems for Safety and Reliability

Source: https://www.bankingnewsai.com/ai-regulation/documents/imda-agentic-testing-starter-kit-2026
Last updated: Nov 2, 2026

IMDA and the AI Verify Foundation published the Starter Kit for Testing Agentic Systems for Safety and Reliability (Version 1.0) in October 2026, a practical reference for testing AI agents that 'act on their environment with limited human involvement' rather than only generating content. It lays out a four-step process — identify the relevant risks for testing, create realistic and robust tests, run tests and analyse logs, and continuously monitor and re-test — and builds on IMDA's earlier Starter Kit for Testing LLM-Based Applications and the Model AI Governance Framework for Agentic AI's third dimension (technical controls). It was released alongside the AI Verify Foundation's accreditation of its first five third-party AI testing firms (AI TAP) and a new Frontier AI Resilience and Security Taskforce (FAIRS).

## At a glance

| Field | Value |
| --- | --- |
| Authority | [IMDA Singapore](https://www.bankingnewsai.com/ai-regulation/imda) |
| Type | Framework |
| Status | In force |
| Published | Oct 14, 2026 |
| Applies to | Enterprise developers, testing teams, third-party testers and compliance/responsible-AI professionals conducting agentic-AI testing, including banks deploying AI agents; voluntary guidance from IMDA and the AI Verify Foundation |
| Official text | https://www.imda.gov.sg/assets/603572eb-724a-46cf-ac12-14fe38e1558c.pdf |

## Key points

- Four-step process: identify the relevant risks for testing (translating 'safety by design' and residual risks into test scenarios); create realistic and robust tests (test environment, logging, task/metric/evaluator design, including tool-use and handoff accuracy); run tests and analyse logs (repeated runs, model-harness swaps, context-window compaction risk); and continuously monitor and re-test, since agentic systems 'introduce additional sources of change through tool and service integrations, memory, and long-horizon interactions'.
- Includes five case studies: RFP extraction agents (Cohere), a code-fix agent (CyberSierra), SDLC-support agents (KBTG), a financial reconciliation agent (EarlyBird AI and Knovel Engineering), and a content-verification agent (IMDA's own MAGIC Agents).
- The financial-reconciliation case study — an agentic accounting system for small enterprises doing invoice extraction, bank-transaction classification, reconciliation and monthly close — tested stateless classification, stateful memory persistence across a three-tier client-memory/global-vendor-master/LLM-fallback architecture, and adversarial prompt-injection attacks via uploaded invoices, run through the Global AI Assurance Sandbox.
- Released the same day as the AI Verify Foundation's AI Testing Personnel Accreditation Programme (AI TAP), which accredited its first five firms — AIDX Tech, Knovel Engineering, PwC Singapore, Resaro and Vulcan — across five risk areas.
- IMDA also formed the Frontier AI Resilience and Security Taskforce (FAIRS, 20+ members), targeting a practical-guidelines report for the infocomm/media sector by H1 2027.

## What changed for banks

The first IMDA/AI Verify testing methodology specifically for agentic systems, with a real financial-services case study (an invoice/reconciliation agent) — direct follow-through on the agentic-AI testing guidelines the tracker has been watching since the January 2026 agentic framework launch.

## Use cases it governs

- [Generative & agentic AI](https://www.bankingnewsai.com/ai-regulation/by-use-case#generative-agentic-ai)
- [Model risk management](https://www.bankingnewsai.com/ai-regulation/by-use-case#model-risk)
- [Third-party & vendor AI](https://www.bankingnewsai.com/ai-regulation/by-use-case#third-party-vendors)
- [AI governance (general)](https://www.bankingnewsai.com/ai-regulation/by-use-case#governance-general)

## FAQ

### Has IMDA published testing guidance for AI agents?

Yes. In October 2026 IMDA and the AI Verify Foundation published the Starter Kit for Testing Agentic Systems for Safety and Reliability (Version 1.0), a four-step testing methodology for agentic AI.

### Is there a case study on financial or accounting AI agents?

Yes. The starter kit includes a case study on EarlyBird AI's agentic accounting system, which tested invoice extraction, bank-transaction classification, reconciliation, stateful memory persistence and adversarial prompt-injection resistance.

## Related documents

- [IMDA Model AI Governance Framework for Agentic AI](https://www.bankingnewsai.com/ai-regulation/documents/imda-model-ai-governance-framework-agentic-ai-2026) — Model AI Governance Framework for Agentic AI (Jan 22, 2026)
- [IMDA Model AI Governance Framework for Generative AI](https://www.bankingnewsai.com/ai-regulation/documents/imda-model-ai-governance-framework-generative-ai-2024) — Model AI Governance Framework for Generative AI: Fostering a Trusted Ecosystem (May 30, 2024)
- [AI Verify Testing Framework](https://www.bankingnewsai.com/ai-regulation/documents/imda-ai-verify-testing-framework) — AI Verify Testing Framework and Toolkit (AI Verify Foundation) (Jun 7, 2023)
- [HKMA discussion paper on banks' use of Agentic AI](https://www.bankingnewsai.com/ai-regulation/documents/hkma-agentic-ai-discussion-paper-2026) — Discussion Paper on the Use of Agentic A.I. by Banks (Nov 2, 2026)
- [Machado interview with Bloomberg (Oct 2026)](https://www.bankingnewsai.com/ai-regulation/documents/ecb-machado-bloomberg-interview-2026-10) — Interview with Bloomberg — Pedro Machado (Oct 30, 2026)
- [Selig Frontier Forum Remarks on Super Intelligence (Oct 2026)](https://www.bankingnewsai.com/ai-regulation/documents/cftc-selig-frontier-forum-super-intelligence-2026) — Remarks at Frontier Forum on Super Intelligence (Oct 28, 2026)
- [2026 BoE/FCA AI survey](https://www.bankingnewsai.com/ai-regulation/documents/uk-ai-in-financial-services-survey-2026) — The Bank of England and FCA's 2026 AI Survey (Oct 26, 2026)
- [Division of Examinations FY2027 Priorities](https://www.bankingnewsai.com/ai-regulation/documents/sec-exam-priorities-fy2027) — Examination Priorities: Fiscal Year 2027 — Division of Examinations (Oct 23, 2026)

Last reviewed Nov 2, 2026. Cite the official text (https://www.imda.gov.sg/assets/603572eb-724a-46cf-ac12-14fe38e1558c.pdf) for the rule and this page for the summary and dates.

---

Canonical page: https://www.bankingnewsai.com/ai-regulation/documents/imda-agentic-testing-starter-kit-2026
Part of [BankingNewsAI](https://www.bankingnewsai.com/) — a free daily brief on AI in banking, an AI regulation tracker (45 authorities, 267 documents) and AI-strategy profiles of the 120 largest US banks. Markdown versions of every reference page: append `.md` to the page URL; index at https://www.bankingnewsai.com/llms.txt.