Well, why use a tree structure when web sites are WEBS?
The main idea of the Site Spider is not to represent the inherent structure of web sites, but to represent their content. The structure is a secondary concern in this case, since the main goal is to list what pages are available in a format familiar to the user. Since there are no common web GUI controls, and a list is too basic, a tree structure is the best bet.