SizeSpotSigs: An Effective Deduplicate Algorithm Considering the Size of Page Content

No abstract is available for this paper.

• Publication year

  2011

• Venue

  Pacific-Asia Conference on Knowledge Discovery and Data Mining

• Publication date

  2011-05-24

• Fields of study

  Computer Science

• Identifiers
  DOI 10.1007/978-3-642-20841-6_44
• External record

  Open on Semantic Scholar

• Source metadata

  Semantic Scholar

• No claims are published for this paper.

• No concepts are published for this paper.

• Approximate Nearest Neighbor: Towards Removing the Curse of Dimensionality

  2012cited by this paper
• Learning URL patterns for webpage de-duplication

  2010cited by this paper
• Group-by skyline query processing in relational engines

  2009cited by this paper
• URL normalization for de-duplication of web pages

  2009cited by this paper
• SpotSigs: robust and efficient near duplicate detection in large web collections

  2008influential reference
• De-duping URLs via rewrite rules

  2008cited by this paper
• Finding near-duplicate web pages: a large-scale evaluation of algorithms

  2006cited by this paper
• Near-duplicate detection by instance-level constrained clustering

  2006cited by this paper
• A document-centric approach to static index pruning in text retrieval systems

  2006cited by this paper
• LSH forest: self-tuning indexes for similarity search

  2005cited by this paper
• Improved robustness of signature-based near-replica detection via lexicon randomization

  2004cited by this paper
• Methods for Identifying Versioned and Plagiarized Documents

  2003cited by this paper
• Similarity estimation techniques from rounding algorithms

  2002cited by this paper
• Collection statistics for fast duplicate document detection

  2002cited by this paper
• Finding interesting associations without support pruning

  2000cited by this paper
• Identifying and Filtering Near-Duplicate Documents

  2000cited by this paper
• Similarity Search in High Dimensions via Hashing

  1999cited by this paper
• Syntactic Clustering of the Web

  1997cited by this paper
• Copy detection mechanisms for digital documents

  1995cited by this paper
• Finding Similar Files in a Large File System

  1994cited by this paper

• Removing Dust By Metacrawler

  2020cites this paper
• DUST Removal Framework Based on Improved Multiple Sequence Alignment Technique

  2019cites this paper
• Parallel Crawling for Detection and Removal of DUST Using DUSTER

  2018cites this paper
• iDUSTER: Improved Method for Removing DUST Based on Efficient Multiple Sequence Alignment Technique

  2018cites this paper
• Speeding up of Search Engine by Detection and Control of Duplicate Documents on the Web

  2016cites this paper
• Removing DUST Using Multiple Alignment of Sequences

  2015cites this paper
• Learning URL Normalization Rules Using Multiple Alignment of Sequences

  2013cites this paper
• Plagiarism Detection for Indonesian Texts

  2013cites this paper