Should I use SocSciBot or LexiURL Searcher to analyse the links between a set of large web sites?
SocSciBot crawls web sites and extracts the hyperlinks from them. You can use it to get comprehensive information about the links between large web sites. SocSciBot will take a long time to crawl these web sites if there are many (more than 10) that you are interested in. LexiURL Searcher gets data on links from Yahoo! and can also give information about the links between large web sites. For example, you can use the Network Diagram wizard option to get a network diagram of the links. This is much faster than SocSciBot but gives less complete lists of links between the web sites. It is recommend to start with LexiURL Searcher and switch to SocSciBot only if you really need the extra information that it gives. This will save a lot of time.