AI Verify
aiverifyfoundation.sg
What it is
AI Verify is an open-source toolkit for evaluating AI systems, with technical tests for fairness, explainability, and robustness in traditional machine-learning models. Users can run tests through a Portal or command line, upload results, complete process checklists, and produce standard or customized reports. AIVT 2.0 supports tabular and image data, taking a model file, preprocessing pipeline, or model API as input. Plugins can extend the toolkit; Veritas adds fairness and transparency tests around threshold trade-offs and explainability plots. The broader framework assesses responsible implementation against 11 AI-governance principles and maps to frameworks and standards including NIST AI RMF and ISO/IEC 42001. Project Moonshot is a separate tool for LLM applications, offering benchmark testing and red teaming. The Toolkit is available under the Apache 2.0 license, with web, API, Linux, and self-hosted platforms listed. AI Verify does not set ethical standards or promise that tested systems are free of risks or biases, or completely safe.
Spec sheet
- Purpose
- AI Verify is an AI governance testing framework and software toolkit that validates AI-system performance against internationally recognised principles through standardised tests.Read 2 Oct 2026 · github.com
- Security
- The Foundation says electronic storage and transmission of personal data are secured with appropriate security technologies.Read 1 Oct 2026 · aiverifyfoundation.sg
- Support
- Users are directed to GitHub discussions, the issue tracker, documentation and the Foundation contact page for assistance.Read 2 Oct 2026 · github.com
- License
- The toolkit is open-sourced under the Apache 2.0 permissive license.Read 1 Oct 2026 · aiverifyfoundation.sg
- Headquarters
- SingaporeRead 28 Sep 2026 · aiverifyfoundation.sg
- Founded
- 2022Read 28 Sep 2026 · aiverifyfoundation.sg
- Data support
- AIVT 2.0 currently supports tabular and image data types and can use a model file, preprocessing pipeline or model API as input.Read 1 Oct 2026 · aiverify-foundation.github.io
- Extensibility
- Users can add testing algorithms and process checklists to existing Toolkit functions.Read 2 Oct 2026 · aiverifyfoundation.sg
- Foundation status
- AI Verify Foundation is a not-for-profit wholly owned subsidiary of Singapore's Infocommunications Media Development Authority.Read 2 Oct 2026 · aiverifyfoundation.sg
- Framework coverage
- The framework assesses responsible implementation against 11 internationally recognised AI-governance principles and covers traditional and generative AI.Read 2 Oct 2026 · aiverifyfoundation.sg
- Framework principles
- The framework contains 11 AI-ethics principles, including transparency, explainability, safety, security, robustness, fairness, data governance and accountability.Read 1 Oct 2026 · aiverifyfoundation.sg
- Generative AI tool
- Project Moonshot assesses LLM applications through benchmark testing and red teaming and implements benchmarks recommended in IMDA's Starter Kit.Read 2 Oct 2026 · aiverifyfoundation.sg
- Integration
- Veritas was integrated into AI Verify to help financial institutions meet common safety-baseline and financial-testing requirements from MAS.Read 2 Oct 2026 · aiverifyfoundation.sg
- International alignment
- The framework is aligned with internationally recognised principles and frameworks from the EU, OECD and Singapore.Read 1 Oct 2026 · aiverifyfoundation.sg
- Limitation
- AI Verify does not define AI ethical standards and does not guarantee that tested systems are free from risks or biases or completely safe.Read 2 Oct 2026 · github.com
- Moonshot interfaces
- Project Moonshot offers a Web UI, interactive CLI, library APIs and Web APIs for MLOps integration.Read 2 Oct 2026 · github.com
- Open source
- The Toolkit is open-sourced under the permissive Apache 2.0 license.Read 2 Oct 2026 · aiverifyfoundation.sg
- Portal and CLI
- Users can run tests through the Portal or command line, upload results, complete process checklists and generate reports.Read 1 Oct 2026 · aiverify-foundation.github.io
- Reporting
- AI Verify includes standard report templates that predefine report layouts, technical tests and process checks, while also allowing customized reports.Read 1 Oct 2026 · aiverify-foundation.github.io
- Reports
- The Toolkit creates customised reports and can combine independent developer and compliance-team work into a full report.Read 2 Oct 2026 · aiverifyfoundation.sg
- Scope limit
- Project Moonshot tests LLM-based applications, while the AI Verify Testing Toolkit tests traditional AI applications for fairness, explainability and robustness.Read 1 Oct 2026 · aiverifyfoundation.sg
- Standards alignment
- The framework is mapped to NIST AI RMF, NIST AI RMF Generative AI Profile, Hiroshima Process Code of Conduct and ISO/IEC 42001.Read 2 Oct 2026 · aiverifyfoundation.sg
- Testing coverage
- The toolkit provides more than eight technical tests for fairness, explainability and robustness.Read 1 Oct 2026 · aiverify-foundation.github.io
- Traditional AI tests
- The Toolkit provides technical tests for fairness, explainability and robustness of traditional machine-learning models.Read 2 Oct 2026 · aiverifyfoundation.sg
- Users
- It is built for data-science and compliance users, and supports both third-party testing and self-assessment.Read 1 Oct 2026 · aiverify-foundation.github.io
- Veritas integration
- Veritas integration adds fairness and transparency tests for threshold trade-offs plus explainability plots.Read 1 Oct 2026 · aiverify-foundation.github.io
- Who can use it
- Anyone can use the AI Verify Testing Framework and Toolkit, including AI owners, developers, researchers, service providers and companies integrating it into their systems.Read 2 Oct 2026 · aiverifyfoundation.sg
Strong points and limits
Strong points
- Technical tests address fairness, explainability, and robustness.
- Supports tabular and image data inputs.
- Reports can combine developer and compliance-team work.
- Open-source under the Apache 2.0 license.
Limits
- The Toolkit tests traditional AI, not LLM applications.
- Current AIVT 2.0 data support is tabular and image.
- It does not guarantee systems are risk-free or unbiased.
Who it suits
It can serve AI owners, developers, researchers, service providers, and companies integrating the toolkit, as well as data-science and compliance users. It supports both self-assessment and third-party testing.
Verdict
AI Verify provides testing and reporting tools alongside a governance framework, with a distinct Moonshot tool for LLM applications. Treat its assessments as evaluation support, not a guarantee of safety or ethical compliance.
Where Specifiction places it
- AI Governance Software#10 of 568.0
- AI governance tools#15 of 567.9