So i know a few of u are computer nerds on here... something i would love to be.

does anyone know anything about black hat???


i want to be able to spider directory websites to find recent updates.... but im clueless

can anyone help me with it... how would it be done,

and also WTF is black hat???

Black Hat is a term for a malicious computer hacker, are you not thinking of red hat ie Linux?
you dont need linux to crawl websites
Web crawler - Wikipedia, the free encyclopedia

Or maybe phil means black hat, as in he wants to spider directory websites for a malicious purpose

Be quiet you or i`ll tell somone you are on a pickup forum in works time

i dont want it maliciously, but i do wanna spider websites.

i wanna be able to gather updated information from business directories.

does anyone know how to do it?

googles says

WebSite-Watcher - Software to check websites for updates and changes (web page monitoring)

ok, i want to use for instance YELL.COM

i want something that will scour the site, look for everything, then every day give me a list of the new additions to the site.

what u showed me there only lets me do it for pages i choose. and i really would prefer not to have to visit every single page on their site.

any suggestions??

Yell.com is MASSIVE to check that for updates will take ages and yell will actually log your IP address and ban your access

ye i know, but thats not what i asked... if i can ip swivel! is it possible?

try using the keyword scraper e.g "data scraper"

can't be arsed to look into it more cos it'll take me all day but that's the term used when referring to e-mail scrapers that collect e-mails for spamming. (don't spam peeps it's a £5000 fine and if you're in itally (midas) it's something like 90,000 euro and jail time bit exesive i think) you may be able to torrent it.

also auto blogging software might work too