>> |
BeAvEr
File :-(, x)
>>76220
it's basically a web crawler. i set it loose on free sites like elephantlist and it goes through all the linked sites and downloads all the images it finds. gotta be hella careful with it though, i ran it on one of my datacenter servers on a gigabit internet connection and it gobbled up just shy of 50Gb of files in 24 hours.
that's WAY too much content to go through, but I found a bunch of gems that i've kept....
|