>> |
Anonymous File :-(, x)
mysql> SELECT COUNT(*) FROM 4s_posts p JOIN 4s_images i ON p.img_id=i.img_id WHERE p.board_id=(SELECT board_id FROM 4s_boards WHERE board_sname='w'); +----------+ | COUNT(*) | +----------+ | 15964 | +----------+ 1 row in set (0.75 sec)
I'm not sharing it yet, but I'll probably get around to cleaning up the code eventually. The front-end needs to be completely revamped, and the color indexing needs to be rewritten so it isn't shitty. All the metadata is scraped from the image data and the contextual information it was found in, so there's none of that stupid tagging bullshit.
Currently indexing (archiving?) all of /e/, /h/, /w/, /wg/, /hc/ and /s/, having ~53,000 unique images across ~58,000 posts (10% average repost rate, lulz). Scrapes twice daily, accumulating about 1,700 new images each scrape.
I have enough disk space to continue scraping at this rate for about the next year, and 5TB bandwidth/month where I'm moving this project to (copying the old shit that was on there to a different server).
Hopefully I'll pull the front-end together so it doesn't suck so hard :<
|