TY - CONF T1 - High-Dimensional Similarity Retrieval Using Dimensional Choice T2 - Similarity Search and Applications, 2008. SISAP 2008. First International Workshop on Y1 - 2008 A1 - Tahmoush,D. A1 - Samet, Hanan KW - data KW - database KW - function;high-dimensional KW - management KW - processing; KW - processing;sequential KW - reduction;database KW - reduction;distance KW - retrieval;query KW - search;data KW - search;similarity KW - similarity KW - system;dimension KW - systems;query AB - There are several pieces of information that can be utilized in order to improve the efficiency of similarity searches on high-dimensional data. The most commonly used information is the distribution of the data itself but the use of dimensional choice based on the information in the query as well as the parameters of the distribution can provide an effective improvement in the query processing speed and storage. The use of this method can produce dimension reduction by as much as a factor of n, the number of data points in the database, over sequential search. We demonstrate that the curse of dimensionality is not based on the dimension of the data itself, but primarily upon the effective dimension of the distance function. We also introduce a new distance function that utilizes fewer dimensions of the higher dimensional space to produce a maximal lower bound distance in order to approximate the full distance function. This work has demonstrated significant dimension reduction, up to 70% reduction with an improvement in accuracy or over 99% with only a 6% loss in accuracy on a prostate cancer data set. JA - Similarity Search and Applications, 2008. SISAP 2008. First International Workshop on M3 - 10.1109/SISAP.2008.20 ER -