Tool Reflection and Evaluation

ALTAI - The Assessment List on Trustworthy Artificial Intelligence

Uploaded by RRI Tools on 23 November 2020
Last modified on 23 November 2020

European AI Alliance

The Assessment List for Trustworthy Artificial Intelligence (ALTAI), is a practical tool that helps business and organisations to self-assess the trustworthiness of their AI systems under development.

The concept of Trustworthy AI was introduced by the High-Level Expert Group on AI (AI HLEG) in the Ethics Guidelines for Trustworthy Artificial Intelligence (AI) and is based on seven key requirements:

  1. Human Agency and Oversight;
  2. Technical Robustness and Safety;
  3. Privacy and Data Governance;
  4. Transparency;
  5. Diversity, Non-discrimination and Fairness;
  6. Environmental and Societal well-being; and
  7. Accountability.

The AI HLEG translated these requirements into a detailed Assessment List, taking into account feedback from a six month long piloting process within the European AI community. 

Through the Assessment List for Trustworthy AI (ALTAI), AI principles are translated into an accessible and dynamic checklist that guides developers and deployers of AI in implementing such principles in practice. ALTAI will help to ensure that users benefit from AI without being exposed to unnecessary risks by indicating a set of concrete steps for self-assessment.

The ALTAI is available in a web-based tool version and also in form of a downloable pdf version

You can start using this web based ALTAI prototype, by following 4 simple steps:

  1. Step1: Register to the ALTAI - create an ALTAI account.
  2. Step 2: Log in to start using the online tool -  after registering, you can log in with your credentials to start creating, saving and editing your own assessment lists.
  3. Step 3: Read the instructions - find practical information on how to complete ALTAI 
  4. Step 4: Share your ideas, questions or remarks via the AI Alliance

How to complete ALTAI

ALTAI is best completed involving a multidisciplinary team of people from within or outside your organisation with specific competences or expertise on each of the 7 requirements and related questions such as:

  • AI designers and AI-developers of the AI system.
  • Data scientists.
  • Procurement officers or specialists.
  • Front-end staff that will use or work with the AI system.
  • Legal/compliance officers.
  • Management.

For each question ALTAI provides guidance in the glossary and by referencing to the relevant parts of the Ethics Guidelines for Trustworthy AI and examples in text boxes alongside the questions.

Upon completing ALTAI, the following will be generated:

  1. A visualisation of the self-assessed level of adherence of the AI system and it's use with the 7 requirements for Trustworthy AI. These results are based on your organisation's own assessment and are solely meant to help you identify the areas of improvement.
  2. Recommendations based on the answers to particular questions.









Related Resources