Crawler

I'm now working on a crawler to gather some date from websites. First I have to create a network of some of these websites (who links to who) and then I'll do some classification about the website (is it about politics, music, etc.). I've done most of the crawling but I have to think about how to do the classification which may not be obvious.