Visual Intelligence Seminar: More than meets the eye: Validation in automated image analysis


Several difficulties with validating AI algorithms will be discussed in this talk, along with suggestions for how to avoid them.
Title: More than meets the eye: Validation in automated image analysis
Presenter: Annika Reinke, Postdoctoral Researcher at DKFZ German Cancer Research Center,
Abstract: The importance of automatic image analysis based on artificial intelligence (AI) is growing rapidly. However, only a small number of algorithms have been successfully applied in real-world settings. The fact that validation is frequently undervalued could be one of the causes. To enable the accurate tracking of scientific progress, however, and to close the current gap between method research and method translation into practice, reliable algorithm validation is essential. Several difficulties with validating AI algorithms will be discussed in this talk, along with suggestions for how to avoid them. In particular, I will address how to choose performance metrics in a problem-aware manner.