White Papers

Fast Indexes and Algorithms for Set Similarity Selection Queries

Overview Data collections often have inconsistencies that arise due to a variety of reasons, and it is desirable to be able to identify and resolve them efficiently. Set similarity queries are commonly used in data cleaning for matching similar data. This paper concentrates on set similarity selection queries: Given a query set, retrieve all sets in a collection with similarity greater than some threshold. Various set similarity measures have been proposed in the past for data cleaning purposes. This paper concentrates on weighted similarity functions like TF/IDF, and introduces variants that are well suited for set similarity selections in a relational database context. These variants have special semantic properties that can be exploited to design very efficient index structures and algorithms for answering queries efficiently.

By downloading you agree to our Terms and Conditions. These include information regarding use of your personal data.

Publisher: AT&T Intellectual Property
File Format: PDF
Date Published: May 29, 2009
Format: White Papers
Topics: Software Engineering

Similiar White Papers

High Level Best Practices in Software Configuration Management

When deploying new software configuration management (SCM) tools, implementers sometimes focus on perfecting fine-graine

Publisher: Perforce Software | Tags: management, software

Software Configuration Management: The Foundation of Global Distributed Development Today

By distributing development, you can create a collaborative work environment staffed by the best developers you can hire

Publisher: Perforce Software | Tags: developers, it department, network

BMC Best Practice Process Flow for Release Management

The Release Management process consists of four procedures. The first procedure is called "Request for Change Handling".

Publisher: BMC Software

Application Lifecycle Management With ClearQuest 7.1.0.0

This overview of the concepts and design goals behind an out-of-the-box Application Lifecycle Management (ALM) solution

Publisher: IBM | Tags: software

White Paper: Tips for Writing Good Use Cases

Writing good use cases is more of an art than a science. In this IBM Rational white paper "Tips for writing good use cas

Publisher: IBM | Tags: software

AT&T Intellectual Property White Papers

On-Demand Webcast: Lowering the TCO for Business Applications

Featured white papers

The Value of Location Intelligence in the Communications Industry

Pitney Bowes

Public Services are under pressure, the challenge is to do more with less. How do you improve citizen satisfaction, increase cost efficiencies and improve service delivery? The power of location intelligence is helping many local authorities...

Download now »
Best Practices for Translating Customer Satisfaction into Revenue

Citrix Online

Today's support organisations are focused on two top-level metrics: financial results and customer satisfaction. For most, it's easy to track financial performance, but customer satisfaction is akin to speaking a foreign language...

Download now »
HP print solutions and 3M

Hewlett-Packard (HP)

The objective for 3M was to optimize office printing infrastructure at 3M locations worldwide, reduce total cost and environmental footprint. Some of the business benefits acheived by switching to HP print solutions...

Download now »