File :-(, x, )
Ero imouto Siterip 337 Anonymous
335 images
ecchi - hentai content

http://www.deadfrog.us/index.php?act=entry&id=10112

I wonder how the echo about the script will be ...
>> Anonymous
So I downloaded this but what do I do with it.
Is there a way to search the images using the tags in rename.txt,can I add my own tags/images and organize them my own way?
I appreciate the images but I'd like to learn more about the why they are organized in all those folders.
Where would be a good place to start?
>> MDG !./N4cM0T/Y
>>207348
click on 1paged.html in !lists

theres no search function (yet)

if you copy all pics you find (except the thumbs of course) to !md5 you can batch rename them to their real tagnames!

see README first.txt
>> MDG !./N4cM0T/Y
(like I said already in Rf.txt the only reason it has this new structure now is, that moe itself , as well as others [konachan for example] could help seeding WITHOUT having to copying all files in a single folder... )
>> MDG !./N4cM0T/Y
>>207353
extracting the thumbs before that btw
>> Anonymous
>>207353
I read the readme and I know about the 1paged.html displaying all the images(haven't extracted the thumbs but I know what it will do).

I was hoping there was some way to search the images based on the tags in rename.txt(and possibly add my own).

So as it is now all I can do with the images is display them all in the 1paged.html and rename them to their tagnames if I wanted to?
>> MDG !./N4cM0T/Y
>>207362
yep
well its "only" a data backup
not a whole website with all the functionality

you can still search for tags in the file of course, any text editor lets you search, searching for the tag gives you the filename

if you delete this line out, Check for data will move the file to !old

all files renamed will be "searchable" as well

however, adding tags/comments and stuff would be easier if you set up ur own imageboard
>> Anonymous
335? I just deleted 5000 on a routine cleaning.
>> Anonymous
>>207410
lol wut ?
whole torrent has 369 files and 596 folders
>> Anonymous
>>207386
Thanks for clearing that up,I appreciate your help.
I thought that maybe there was a way to do what I wanted using the extra files you left in the torrent to make my own localized imageboard(like a custom danbooru clone or something) but I have no idea how to start from scratch(I don't know how to code).
>> MDG !./N4cM0T/Y
>>207437
well, what excatly do you want ? ;)

Adding tags to pics and making them searchable in a html format basically needs a whole website, apache / php + sql ...

Easiest thing I could do would be another button in my gui, and a function which lets you search for ->ONE<- tag and then goes through rename.txt making another html with just these images!
>> Anonymous
>>207439
What I'd like is something like that and the ability to easily add my own images and tags into the database.
I would even go as far as manually adding my own tags/md5 image names in the rename.txt if there was no easier way.

Extra:
Is there any way to use the old danbooru .xml files to generate a rename.txt? Would it recognize/organize the images if I used http://tinyboofoo.foone.org/ and downloaded the old danbooru image filenames?
>> MDG !./N4cM0T/Y
>>207444
>>tags into the database.

Thats the main problem here!
Its not YOUR DB , its imoutos !!

If you want to make your own imageboard, have fun.

The siterip torrent -however- doesnt need such abilities.
As I said, its a backup, not a fully running clone.
(The xml infos are btw. almost enough to start ur own danb. btw)

>> http://tinyboofoo.foone.org/
lemme check
>> Anonymous
>>207445
I understood what you said before that it was only a data backup in the torrent.
But what I did was put a random image I had into!md5,used the "Convert files in !md5 to md5.ext" function in your GUI then manually added the new name into the rename.txt,added some random tags then used the "rename files in!md5 to tagnames" to rename the image to the tags I added.
If it were searchable then what I think I did was exactly what I wanted(added my new image to the database,maybe I'm using the wrong word?)
Like I said I'm only experimenting here,I'm not 100% clear as to what I'm doing.
>> MDG !./N4cM0T/Y
>>207444
works... for me ! :p

f3824ad985f121187065c4eaeae22875.jpg \/ asahina_mikuru cosplay mizuhara_arisa suzumiya_haruhi_no_yuuutsu waitress
56ca0801a6a5a82c73b53e11a0489011.jpg \/ aizawa_yuuichi crossover gundam gundam_seed minase_akiko parody spoilers what
a5a84be9f95dc90d5d8de75962facf29.jpg \/ cosplay mizuhara_arisa seifuku suzumiya_haruhi suzumiya_haruhi_no_yuuutsu
6d0169d32c175316b744266843cae762.jpg \/ misteor reborn
b0b53e29fdeb13285591a524f23972d4.gif \/ harada_takehito pleinair
0fd2bbdeffe508c97baddd0bd0671b1f.jpg \/ bdsm bondage femdom riding_crop thighhighs tongue
7c58051ed6afd0908441dd1a2939ddd3.jpg \/ elfgirl game_cover gaw japanese popful_mail tatto
32f90eb93801e754cbaecabdc143c48b.jpg \/ elfgirl gaw popful_mail tatto
c6ac2006245e45e75b77b17acf49d789.jpg \/ breasts censored cum eyeshield_21 kiss paizuri straight
2931c6a9f78f590aa644619008912b8d.jpg \/ funny game_cg? panties panty_pull peace@pieces tagme
e5b4230a704b21ccadda4cd6f07104c0.jpg \/ male yaoi
996521bd3add5eb6fcf463a1d7db6705.jpg \/ boku_no_pico shota yaoi
43c1d36584d2e45d1c44dade50280d48.jpg \/ boku_no_pico pico shouta yaoi
16cd195d16df80166dd95e1c2725407f.jpg \/ benjamin_franklin comic koolaid what
dd992e043281bb8004bc03f01d246e4e.jpg \/ breasts goo_girl water
017b0791b5cd5e53e26c362041b94710.jpg \/ bad_post what yellow
167085f807a0fad6b7914023e4dfe4a9.jpg \/ cold ribbons wings

Well ... just had to make a small adjustment. However all files make my java crash! ;)
Just too much... Like ... uhm... 104k images ?
>> Anonymous
>>207449
Cool!(I hoped it would work)

What made java crash,generating the rename.txt?
>> MDG !./N4cM0T/Y
>>207451
looool
it was not the heapsize (yet)

there was an empty xml, which caused the index to go out of bounce (yeah yeah i know common mistake... didnt make any errorcheck against that)
So i just made a rename.txt for WHOLE tinyboofoo... (well for the rip of them)

1paged.html worked, TOO !
but since i have no files from them, i cant do anything more...

*checking renaming*
>> MDG !./N4cM0T/Y
>>207452
WORKS WORKS WORKS !!!

So here it is :

rename.txt for tinyboofoo (over 100k images + tagnames, make 1paged.html on ur own)
>> Anonymous
>>207454
Amazing!
Now about adding that search button in your GUI...would it be possible with the rename.txt you just uploaded?
>> MDG !./N4cM0T/Y
>>207456
?
i would prog a search function for all kinds of rename.txt of course
shouldnt be too hard, but again i doubt i can do more than 1 tag without problems...

cant do that now though, maybe over the week... ;)
>> Anonymous
>>207458
Searching one tag at a time would be good(although multiple tags would be epic).
If you could add it to your GUI whenever you have the time I would appreciate it.
>> ?????? !4ChanZ1IP.
Thanks for this man. Any chance of a konachan siterip ?
>> MDG !./N4cM0T/Y
>>207560

asked kona admin about this... doesnt seem too happy about it ... :/
>> ?????? !4ChanZ1IP.
( ?_?)( ?_?)( ?_?)??0??
>> MDG !./N4cM0T/Y
     File :-(, x)
>>207459
done , lol ...

I just wrote an epic (= multiple tag) search function! ;]
Was easier than I thought...

>> Anonymous
I can't get this to work! I got the latest Java so that's not the problem. I read through your readme file but it only tells me what clicking a button should do. But clicking does nothing. Absolutely nothing happens. I've ttried this on both the ecchi rip and the original site rip. But no matter which directory I plop this program in, it still does absolutely nothing. It doesn't matter whether I rename md5 to !md5, nothing happens. Could you please tell in detail where things go, what directories need to be renamed/created etc etc?
>> MDG !./N4cM0T/Y
>>207616

If you downloaded all
extracted all thumbs !thumbs
then clicking on x should do y

Check files in !md5 - should give out 3 lines, 0 files found 0% and 335 files missing
Check files in data - 335 files found, 100%, 0 missing
Convert files in !md5 - nothing, since there are no files in !md5
Rename files - nothing, theres nothing in md5
Make 12/23 folder - nothing bc there are no files in !md5
Convert posts to xml - resets rename.txt to zero content! (whoops, well bc there is no posts.xml yet)
Convert xmls to xml - 19kb big 335 image rename.txt
Make 1 paged - overwrite 1paged.html with a newer date...

So what did you do ? What do you want ?
Moving prog to other folder is a VERY VERY BAD IDEA btw!!

If you want to rename files, search for files (except thumbs) and move/copy them to !md5
>> MDG !./N4cM0T/Y
>>207620
clicking on 1paged.html should work even without thumbs extracted... but you cant see anything then ^^
>> Anonymous
bump
>> MDG !./N4cM0T/Y
if anybody is interested in the TagSearch beta, ill upload it tmrw
>> Anonymous
>>207652
Thanks!
I can't wait.(anon from yesterday)
>> Anonymous
>>207620
It simply refuses to do anything. Maybe it's not compatible with Win2k? Dunno, I think I'll just use my usual renamer, all I have to do is replace the slashes \/ in the rename file with a comma and I'm ready to go.
>> Anonymous
>>207655
You have to make a folder named !md5(it wasn't included in the torrent,at least in what I downloaded),then add the images with their md5 names into it then click the button to rename them to the tags.
>> MDG !./N4cM0T/Y
>>207656
oh, this would be troublesome if azureus didnt include empty folders !!
next time ill put at least 1 file in !md5 then
>> Anonymous
>>207657
Or you could write it in the readme(that you need to create the folder).
It was easy enough to figure out though.
>> MDG !./N4cM0T/Y
>>207659
See the part about structure in README first...

!md5 was the first folder i mentioned, well thought it was already there ;)
>> Anonymous
MDG, what are you talking about when you mean search is too restrictive on the danboorus?

multiple tags are separated by spaces

"haruhi heel" doesn't work on moe because the tags don't EXIST. there's no heel tag and the full series name is used...

>> Anonymous
i'm also curious as to...

what exactly the point of it is
>> MDG !./N4cM0T/Y
>>207746
search on danboos dont search for the string and compare them with LIKE or something.

so they wont find haruhi because their tagname is haruhi_suzumiya or even the longer one.

So if you want to search for ANYTHING you dont know the exact names youre screwed...

"Hmm, I saw a pic of this hot blue haired girl... Cant remember her name though, something with chi. And the series was about metal.
=> search : chi blue metal
tiny/danbo : 0 results
java : 3 results "

Of course the tag heel doesnt exist, but its part of another tag which does exist! Same for haruhi.
But danbo search doesnt work with it !
Why ?
Because it would be too cpu intense!! (most likely)
>> Anonymous
>>207746
I think his search goes by the words you type even if they don't match a full tag.
In his example he searched "haruhi" and "heel" by themselves which brought back results for "high_heel" and "suzumiya_haruhi" together.
Normally you would have to search for "suzumiya_haruhi high_heel" to get results right?
>> Anonymous
>>207754
lol,beat to it by the man himself.

Any ETA for your updated GUI?
>> MDG !./N4cM0T/Y
>>207753
besides, i cant even fucking search for 3 tags at once @ danb.don.us ! -.-
(as normal regged user, anon users cant even search for more tag than 1 !)
>> Anonymous
wrong again

http://moe.imouto.org/post?tags=*nino*&commit=Search

works for me
>> Anonymous
oh and you can't search for width: height: (or the less/greater than dimensions) either here. :/
>> Anonymous
well all MDG does is pretend he's important here, I don't want him to cry too hard if that's taken away so quickly :(
>> MDG !./N4cM0T/Y
>>207758

Hows the syntax for searching for more than 1 term with wildcards ?
Seems like they are connected with OR, too ...

Tinyboofoo has wildcards disabled! ;)
*haruhi* doesnt find ANYTHING !
Basically ALL huger imageboards (moe is still small in filecount) have wildcards disabled...

>>207759

would be easy (read: somewhat really easy) to implement...
rename.txt would then have rows like :

md5 \/ tag width:height
>> MDG !./N4cM0T/Y
>>207760
Just for your info, theres no (read NO!) way any antivirus software would detect anything wrong with my prog... ;)
>> MDG !./N4cM0T/Y
oh @ moe again

http://moe.imouto.org/post?tags=haruhi*&commit=Search
produces strange results

http://moe.imouto.org/post?tags=*nino*&commit=Search
has btw. alot of duplicates
*haruhi* , too...
>> Anonymous
>>207762
wtf, if it's written in java, how can it be a virus
>> MDG !./N4cM0T/Y
>>207764
hmmm, true... guess i was wrong
>> Anonymous
Hey MDG,how/when are you going to release the new GUI?
>> MDG !./N4cM0T/Y
>>207759
btw. the major annoyance of most (if not all?!) imageboards is : they dont save their width+height in the xmls ;<

its in moes posts.xml yeah. but guess ill have to use my imageinfo class for my real project...
>> MDG !./N4cM0T/Y
>>207767
NOW
http://www.deadfrog.us/index.php?act=entry&id=10112
>> Anonymous
     File :-(, x)
>>207769
Success!
Thank you MDG.
>> MDG !./N4cM0T/Y
>>207772
do you have a whole backup of danbo? oO

Prog still needs lots of work... The guifeedback is like nonexistant... There no way to stop the md5/foldermaking process either...

But java threads still give me nightmares ;<
>> Anonymous
>>207774
I just have what I need lol.
(I just batch download the images by the tag from tinyboofoo and thanks to you I now have a way to search my growing collection locally)
I'm going to keep messing with it to see if I run into any problems.

What do you mean stop the md5/folder making process?
>> MDG !./N4cM0T/Y
>>207776
try foldering/md5ing whole 18,4gb of moe at once! ;)

Gui will "hang" for a long time, but it should work.

I upgraded the JVM size (doubled it to 128). Im not sure where the limit of posts in rename will be... Maybe 6mil ? 8mil? Should be enough for now, but a single xml for all files (like posts.xml of moe) will probably be too big soon!
>> Anonymous
>>207777
I'm just adding a little bit at a time and everything seems to be working great,I've found out that it will not send a duplicate image from !md5 to it's 00-ff folder which is great for weeding out dups.
>> Anonymous
(this is for the new GUI)
I ran into a little snag.
I put images into !md5 then used the "Make/12/34/1234 danb folder structure" button in the GUI to send the images to their respective folders,it worked a second time but now it's not working.
The GUI just disappears and the images in !md5 don't move.
I don't think it's creating all the folders it needs to send the images to so it just crashes.
Do you know what's happening MDG or a way to fix it?
>> MDG !./N4cM0T/Y
>>207780
well if you check md5 it moves all not found files to !old
same for check data

>>207781
any more infos?
filenames in !md5
any folders in !md5 ? (folders there are evil!)

i havent rly excluded an error if you try to make folders with renamed files...
>> MDG !./N4cM0T/Y
>>207781
if (s.substring(0,s.indexOf(".")).length()!=32){
System.out.println("Warning! Non MD5-named files found!");
System.out.println("Shutting down...");
System.exit(0);
}
>> Anonymous
Right now I'm trying it with 1 image in !md5.
I ran the md5 check and it's a match in the rename.txt.
The image needs to be put in a folder that is not being generated in order for it to show up full size in a tag search result(the thumbnail for the image shows up fine and tells me what folder is not found)
>> MDG !./N4cM0T/Y
>>207787
whats the (full) image/file name ?
>> Anonymous
>>207788
0dd63570daafeb37fec32902c60216f5.jpg
For some reason it's not making the folders /od/d6/.
I unzipped another copy of "data.rar" you uploaded and from that I was able to generate the right folders in that new copy so I guess it has something to do with adding it to the old folders.
>> Anonymous
Basically this is what happened.
I added a bunch of images to !md5 then used the GUI to generate all the subfolders(00-ff) and send the images to them,then I added another image to !md5 the used the GUI again to send the new image to a newly generated folder.Now it's not working for any images I put in !md5 even though they are all a match in the rename.txt.
>> MDG !./N4cM0T/Y
Ah, what about thumbs.db? ^^

Did you view files via minature or something in windows ?

If theres a thumbs.db in !md5 it doesnt work (since script finds non 32 digit file)

Gotta make an exception for that

right now , let your explorer or something show all files, including system files
>> MDG !./N4cM0T/Y
>>207791
hmm, let me debug the file again
*scratches head*
>> MDG !./N4cM0T/Y
>>207792
works, check for thumbs.db
>> Anonymous
>>207791
You crazy genius!
Deleting thumbs.db fixed the problem!
>> MDG !./N4cM0T/Y
>>207795
If you would have clicked on rename to md5.ext (so making md5 strings AGAIN)
it would have worked again !!

however, you would then create an extra folder with md5.db :D

>> MDG !./N4cM0T/Y
>>207791
String[] ignoredfilenames = {"Thumbs.db","Thumb.db","thumbs.db","thumb.db"&#
44;".DS_Store",".trash"};

anyone knows more ?
.DS_Store and .trash are from mac it seems
>> Anonymous
After renaming the files I feel I have to chip in on the limits of search. The insistence of danbooru type boards on exact searches, ie no wild cards, seems to lead to a great deal of redundancy in naming practices and unnecessary file lengths after renaming. You get stuff like people adding the tags mahou_shoujo_lyrical_nanoha and mahou_shoujo_lyrical_nanoha_strikers to the same picture. Seriously, people just search on nanoha or strikers. This is a badly thought-out tag practice serving the database, not people. Tags like that can easily be shortened to nanoha_a's, nanoha_strikers etc.

In my case I came up against the 256 character string length bug. I can't rename or even delete these files. Fortunately I could rename the folders to "!" and "M" which brought total string length below 256 characters. Really annoying.

As an aside there are also completionist idiots who think that if there are tiny icons of characters in a magazine scan spread, then they absolutely have to tag those characters. Every single one of them... with full names... as if anybody cares!!! But that's not the database's fault, that's just people being idiots.
>> Anonymous
I found something with search worth noting.
When you do a search for a word that is a tag by itself it will pull up results for tags that have that word in them but are completely unrelated.
Example:
Searching for "yuri" will also bring up results for kurata_sayuri, hitotsubashi_yurie, sakazaki_yuri, etc. which is not good.

Should be fixable right?
>> Anonymous
>>207862again
I found out that adding a space before the tag(" yuri" in this case) will help filter out bad results but I think there are a few unrelated results still displaying.
>> MDG !./N4cM0T/Y
>>207862
Thats the way I want the tagsearch function to be!
Because itll find things whose tag is longer than most of us would search (like haruhi or nanoha)

However, implementing a strict tag search shouldnt be any problem... Ill think about it in 2 hours...
>> MDG !./N4cM0T/Y
>>207870
Oh how about

" yuri " ?

(should work for most, but not the ones at the end or beginning of rename though)
>> MDG !./N4cM0T/Y
>>207862
fixed

New jar again : Added exact tag search, added real md5 check/thumbs ignore

Btw. the difference between "google" yuri and " yuri" and exact yuri :
>> Anonymous
>>207923
Works perfect,thanks again!

The only thing lacking now is an easy way to tag and search new images without having to manually add each of them to rename.txt(that does work for building a custom searchable image database)
>> MDG !./N4cM0T/Y
>>207938
Well thats what the imageboards are for... Way more ppl to tag as well... Right? ;)

Im done so far. Maybe Ill look how to get a decent rename.txt of moe+danbo+kona+achro. Should work on my real project again, too...

Im out. For now...
>> Anonymous
could just run danbooru locally couldn't you?
>> MDG !./N4cM0T/Y
>>207976
Well, script was done by me so I could make torrents more easily, since I usually just download in a single folder. So checkfiles and md5todata were the first ryl needed features...

Then I wanted to rename things , undo this step of course (md5ing), then my 1page for way better/faster browsing... And now we even have a search function which is way FASTER and better than the original one...
>> MDG !./N4cM0T/Y
>>207977
seems like duplicates on tagsearches are a "feature" on danboos , too...
>> Anonymous
mdg, take it up with rq -_-;
>> MDG !./N4cM0T/Y
>>207989
I doubt he will be pleased with this... Dovac (moe/ero) doesnt seem to the rips as well...
Shuugo either...
>> MDG !./N4cM0T/Y
>>207996
like missing in 2. sentence ugh... late already
>> MDG !./N4cM0T/Y
     File :-(, x)
Got rename.txt of konachan.com
and anime-chronicles...

a-c however needs another check... since there are no extension infos on mainpage ;<
>> MDG !./N4cM0T/Y
fixed m5ing , it now works if filenames have additional "." in them

now adding a check for names in md5 (a-c files have no extensions ;< )
>> MDG !./N4cM0T/Y
Theres a discussion going on, whether ero will stay as seperate danbo or not, dovac wants to merge it with moe.

So there probably wont be a next update... ;<
>> Anonymous
How to get free shit from the internet, like Amazon gift certificates and shit:

Step 1: Install Firefox autoreloader: http://tinyurl.com/32wqmn

Step 2: Go to this site: http://tinyurl.com/3xfpfv and sign up. Make sure to uncheck the box that lets them send you email offers and shit.

Step 3: Go to the Winzy search page and input any search. (vagoo, etc.)

Step 4: Set Firefox to autoreload the page every 5 seconds. Stop every few seconds to check for prizes. If you see one you can claim, stop refreshing and click. There can only be one pending prize at a time.

Step 5: ?????

Step 6: Profit. I won a $10 gift certificate in the first day. It might take longer, but if you just set it up and leave it every day, you get free shit.
>> MDG !./N4cM0T/Y
looks bad for ero i guess...
>> Anonymous
OP, your a fucking faggot! Split those up, me need moar than one image!!!
>> Anonymous
>>209046
No you're a hueg faggot
>> MDG !./N4cM0T/Y
>>209046
wut ?
>> MDG !./N4cM0T/Y
>>208343
Discussion over it seems : Ero will be merged into Moe...

So no updates on this one, torrent will be deleted once leechers reach 0