What is HarvestMan?
HarvestMan (with a capital ‘H’ and a capital ‘M’) is a webcrawler program. HarvestMan belongs to a family of programs frequently addressed as webcrawlers, webbots, web-robots, offline browsers etc. These programs are used to crawl a distributed network of computers like the Internet and download files locally. 1.2. Why do you call it HarvestMan? The name “HarvestMan” is derived from a kind of small spider found in different parts of the world called “Daddy long legs” or Opiliones. Since this program is a web-spider, the analogy was compelling to name it after some species of spiders. The process of downloading data from websites is sometimes called harvesting. Both these similarities gave arise to the name HarvestMan.
