any way to pre-filter sites as we are crawling?

Submitted by on Thu, 05/17/2012 - 21:47

The following is a question from a VOSON user, sent via email:

I'm wondering if there's an easy way to pre-filter sites in VOSON as we're crawling (i.e. we have a list of about 40 - 50 sites that we want to exclude based on previous tests).

Forums: 
VOSON System Users
  • anon

    In the VOSON System (web app version), if you put the sites in as "pruned sites" (with the voson database loaded, Preferences->Node pre-process->database), then while they will still get picked up in the crawl, they will not be present in any voson-analysis database that is created.

    Just to let you know, VOSON doesn't automatically snowball during the crawl, so only sites that you have set as seed sites will be crawled. So any filtered/pruned sites will not be crawled.

    May 17, 2012