Workshop: Danish Standard for Computer Vision Metrics

This workshop is organized by the REPAI: Responsible AI for Value Creation center at AAU and P1, featuring colleagues from Dansk Standard. Contact: Anders Skaarup Johansen <asjo@create.aau.dk>.

The European AI-Act is fast approaching and with that so are methods for assessing compliance. This workshop will be a collaborative effort together with Dansk Standard to help inform and formulate relevant metrics and methods for assessing the accuracy of computer vision systems in accordance with the European AI-Act. What makes sense to evaluate? What are the pit falls of certain metrics and evaluation metrics? These are important questions that could shape how computer vision systems will be assessed under the coming regulation. The talks include an introduction and overview of the standardization process, as well as the scope and discussion points at the heart of the development of upcoming standards.

The workshop audience is computer vision researchers and students interested in compliance with EU AI Act regulation as well as small and medium-sized businesses who use computer vision and want to know how comply.

Schedule:

9:00 – 9:15         
Introduction

9:15– 10:00       
Standardization, AI-Act and CEN/CEN-ELEC JTC21

10:30 – 11:30       
Computer Vision accuracy and robustness scope

11:30 – 12:30   
Break / Lunch

12:30 – 13:15     
How do you choose a metric?

13:15 – 14:00   
Considerations for accurate evaluation in real-world scenarios

14:00 – 14:30     
Wrap-up