Detection of Emotions in Artworks Using a Convolutional Neural Network Trained on Non-Artistic Images: A Methodology to Reduce the Cross-Depiction Problem

César González-Martín, Miguel Carrasco, Thomas Gustavo Wachter Wielandt

Producción científica: Contribución a una revistaArtículorevisión exhaustiva

Resumen

This research is framed within the study of automatic recognition of emotions in artworks, proposing a methodology to improve performance in detecting emotions when a network is trained with an image type different from the entry type, which is known as the cross-depiction problem. To achieve this, we used the QuickShift algorithm, which simplifies images’ resources, and applied it to the Open Affective Standardized Image (OASIS) dataset as well as the WikiArt Emotion dataset. Both datasets are also unified under a binary emotional system. Subsequently, a model was trained based on a convolutional neural network using OASIS as a learning base, in order to then be applied on the WikiArt Emotion dataset. The results show an improvement in the general prediction performance when applying QuickShift (73% overall). However, we can observe that artistic style influences the results, with minimalist art being incompatible with the methodology proposed.

Idioma originalInglés
Páginas (desde-hasta)38-64
Número de páginas27
PublicaciónEmpirical Studies of the Arts
Volumen42
N.º1
DOI
EstadoPublicada - ene. 2024
Publicado de forma externa

Huella

Profundice en los temas de investigación de 'Detection of Emotions in Artworks Using a Convolutional Neural Network Trained on Non-Artistic Images: A Methodology to Reduce the Cross-Depiction Problem'. En conjunto forman una huella única.

Citar esto