Important Notice: Our web hosting provider recently started charging us for additional visits, which was unexpected. In response, we're seeking donations. Depending on the situation, we may explore different monetization options for our Community and Expert Contributors. It's crucial to provide more returns for their expertise and offer more Expert Validated Answers or AI Validated Answers. Learn more about our hosting issue here.

How does SocSciBot 4 perform duplicate elimination and why has it not identified all of the duplicates?

April 26, 2017duplicate duplicates Elimination perform socscibot

0

Posted

How does SocSciBot 4 perform duplicate elimination and why has it not identified all of the duplicates?

1 Answer

0

Posted

Duplicate elimination in SocSciBot is done through comparison of the full HTML of the two pages. This can be ‘fooled’ if the pages contain changeable elements, such as a text counter, rotating adverts or other dynamic elements.