Affiliations: [a] National Research Council, ISTC-STLab, Catania, Italy | [b] Fondazione Bruno Kessler, Trento, Italy | [c] Global Security and Crisis Management Unit, Institute for the Protection and Security of the Citizen, Joint Research Centre, European Commission, Ispra, Italy
Correspondence:
[*]
Corresponding author: Sergio Consoli, National Research Council, ISTC-STLab, Via Gaifami 18, 95028 Catania, Italy. Tel.: +39 095 7338 390 391; E-mail:sergio.consoli@istc.cnr.it
Abstract: In application fields such as linguistic and computer vision there is an increasing need of reference data for the empirical analysis of new methods and the assessment of different algorithms. Current evaluations are based on few real-life collections or on artificial data generators built on models that are too simplistic to cover real scenarios and to allow researchers to identify crucial limitations of their algorithms. We propose a flexible approach to generate high-dimensional vectors, with directional properties controlled by the distribution of their pair-wise cosine distances. The generation method is formulated as a non-linear continuous optimization problem, which is solved with a computationally efficient local search algorithm. We show with an empirical study that our approach can create large high-dimensional data collections with desired properties in reasonable time.
