en
Scientific article
English

Inductive t-SNE via deep learning to visualize multi-label images

Published inEngineering Applications of Artificial Intelligence, vol. 81, p. 336-345
Publication date2019
Abstract

This work presents a methodology for dimensionality reduction of images with multiple occurrences of multiple objects, such that they can be placed on a 2-dimensional plane under the constrain that nearby images are similar in terms of visual content and semantics. The first part of this methodology adds inductive capabilities to the well known t-SNE method used for visualization, thus making possible its generalization for unseen data, as opposed to previous extensions with only transductive capabilities. This is achieved by pairing the base t-SNE with a Deep Neural Network. The second part exploits semantic information to perform supervised dimensionality reduction, which results in better separability of the low-dimensional space, this is, it separates better images with no relevance, while retaining the proximity of those images with partial relevance. Since dealing with images having multiple occurrences of multiple objects requires the consideration of partial relevance, additionally we present a definition of partial relevance for the evaluation of classification and retrieval scenarios on images, or other documents, that share contents, at least partially.

Keywords
  • Multi-label images
  • Partial relevance
  • Dimensionality reduction
Citation (ISO format)
ROMAN RANGEL, Edgar Francisco, MARCHAND-MAILLET, Stéphane. Inductive t-SNE via deep learning to visualize multi-label images. In: Engineering Applications of Artificial Intelligence, 2019, vol. 81, p. 336–345. doi: 10.1016/j.engappai.2019.01.015
Main files (1)
Article (Published version)
accessLevelRestricted
Identifiers
ISSN of the journal0952-1976
384views
6downloads

Technical informations

Creation07/29/2019 5:06:00 PM
First validation07/29/2019 5:06:00 PM
Update time03/15/2023 5:49:26 PM
Status update03/15/2023 5:49:25 PM
Last indexation01/17/2024 5:57:37 AM
All rights reserved by Archive ouverte UNIGE and the University of GenevaunigeBlack