arXiv · 2308.12134
DarkDiff: Explainable web page similarity of TOR onion sites
Abstract
In large-scale data analysis, near-duplicates are often a problem. For example, with two near-duplicate phishing emails, a difference in the salutation (Mr versus Ms) is not essential, but whether it is bank A or B is important. The state-of-the-art in near-duplicate detection is a black box approach (MinHash), so one only knows that emails are near-duplicates, but not why. We present DarkDiff, which can efficiently detect near-duplicates while providing the reason why there is a near-duplicate. We have developed DarkDiff to detect near-duplicates of homepages on the Darkweb. DarkDiff works well on those pages because they resemble the clear web of the past.
Explore related subjects
Keep this discovery
Pieter Hartel, Eljo Haspels, Mark van Staalduinen, Octavio Texeira. 2023-08-23. DarkDiff: Explainable web page similarity of TOR onion sites. https://arxiv.org/abs/2308.12134
Cite the original work for its findings. Save a collection to share your selection of sources.