Efficient and Effective Similarity Search over Probabilistic Data based on Earth Mover's Distance
| dc.contributor.author | XU, Jia | en_US |
| dc.contributor.author | ZHANG, Zhenjie | en_US |
| dc.contributor.author | TUNG, Anthony K.H. | en_US |
| dc.contributor.author | YU, Ge | en_US |
| dc.date.accessioned | 2010-05-05T08:36:22Z | en_US |
| dc.date.accessioned | 2017-01-23T07:00:14Z | |
| dc.date.available | 2010-05-05T08:36:22Z | en_US |
| dc.date.available | 2017-01-23T07:00:14Z | |
| dc.date.issued | 2010-05-03 | en_US |
| dc.description.abstract | Probabilistic data is coming as a new deluge along with the technical advances on geographical tracking, multimedia processing, sensor network and RFID. While similarity search is an important functionality supporting the manipulation of probabilistic data, it raises new challenges to traditional relational database. The problem stems from the limited e®ectiveness of the distance metric supported by the existing database system. On the other hand, some complicated distance operators have been proved their values for better distinguishing ability in probabilistic domain. In this paper, we discuss the similarity search problem with the Earth Mover's Distance, which is the most successful distance metric on probabilistic histograms and an expensive operator with cubic complexity. We present a new database approach to answer range queries and k-nearest neighbor queries on probabilistic data, on the basis of Earth Mover's Distance. Our solution utilizes the primal-dual theory in linear programming and deploys B+ tree index structures for e®ective candidate pruning. Extensive experiments show that our proposal dramatically improves the scalability of probabilistic databases. | en_US |
| dc.format.extent | 1357840 bytes | en_US |
| dc.format.mimetype | application/pdf | en_US |
| dc.identifier.uri | https://dl.comp.nus.edu.sg/xmlui/handle/1900.100/3178 | en_US |
| dc.language.iso | en | en_US |
| dc.relation.ispartofseries | TRA5/10 | en_US |
| dc.title | Efficient and Effective Similarity Search over Probabilistic Data based on Earth Mover's Distance | en_US |
| dc.type | Technical Report | en_US |