[Python] Multithreaded 4chan image downloader

[d4rkcat]

I wrote this after seeing this thread by Fur on a Ruby 4chan downloader.
I decided it was a nice idea and so gave it an upgrade to a real scripting language, python.
It is blazingly fast and if you have a great connection, you can increase the number of threads with the -n switch to make it even faster.

Usage:

Code: [Select]

./threaddumper.py -b b -t 584978710
Will download every image in the 584978710 thread on /b/

Code: [Select]

./threaddumper.py -b b -t 584978710 -m
Will download every image in the 584978710 thread on /b/ and then monitor the thread for new images and download them when available.

Code: [Select]

./chandumper.py -b b -q
Will download every image in every thread on /b/ and be quiet with the output.

threaddumper.py:

[gist]d4rkcat/a00241bc00bbbd4ba2ff[/gist]

chandumper.py:

[gist]d4rkcat/22b1343d97da7100b2ad[/gist]

[Kulverstukas]

Very good, but is there any practical use of it?

[d4rkcat]

Very good, but is there any practical use of it?

LOL, no ofc not.
I guess someone could learn how download shit 30 times faster than normal.
It entertained me for an hour or so.

[Psycho_Coder]

Good work. YOu could gain significant faster parsing and with lxml instead of beautiful soup. Also try to avoid urllib2 and move to python requests. urllib3 would be fine as well.

[d4rkcat]

Good work. YOu could gain significant faster parsing and with lxml instead of beautiful soup. Also try to avoid urllib2 and move to python requests. urllib3 would be fine as well.

Great ideas, done and done.
Thank you for your advice. 
+1