You can manage bookmarks using lists, please log in to your user account for this.
Media type:
E-Article
Title:
Intrinsic dimension estimation for locally undersampled data
Contributor:
Erba, Vittorio;
Gherardi, Marco;
Rotondo, Pietro
Published:
Springer Science and Business Media LLC, 2019
Published in:
Scientific Reports, 9 (2019) 1
Language:
English
DOI:
10.1038/s41598-019-53549-9
ISSN:
2045-2322
Origination:
Footnote:
Description:
AbstractIdentifying the minimal number of parameters needed to describe a dataset is a challenging problem known in the literature as intrinsic dimension estimation. All the existing intrinsic dimension estimators are not reliable whenever the dataset is locally undersampled, and this is at the core of the so called curse of dimensionality. Here we introduce a new intrinsic dimension estimator that leverages on simple properties of the tangent space of a manifold and extends the usual correlation integral estimator to alleviate the extreme undersampling problem. Based on this insight, we explore a multiscale generalization of the algorithm that is capable of (i) identifying multiple dimensionalities in a dataset, and (ii) providing accurate estimates of the intrinsic dimension of extremely curved manifolds. We test the method on manifolds generated from global transformations of high-contrast images, relevant for invariant object recognition and considered a challenge for state-of-the-art intrinsic dimension estimators.