[Python] Check links

[Kulverstukas]

Uhm this is a simple script I made to check a list of links for dead ones and pick out the good ones.
List is a text file with links. Usage is also simple: checkLinks.py filename
Good links will be output to a file named good_filename.

Script: checkLinks.py

[neusbeer]

this one can be handy .. thnxs
does this also check file existence on sites?
if I have for example a large list with
http://<link>/pvt/serice.pwd
?

[Kulverstukas]

Sorry, no. It will only check if the link (or IP) is online and responsive. It does not check for file existence on remote hosts.

[NeX]

this one can be handy .. thnxs
does this also check file existence on sites?
if I have for example a large list with
http://<link>/pvt/serice.pwd
?

wget --spider does the job
You can then combine it with -i for input file, i.e. bookmars file, or whatever, and -o for output..

[neusbeer]

yes I know.. but that's a slow method.. (which I'm using now)..

[xzid]

this one can be handy .. thnxs
does this also check file existence on sites?
if I have for example a large list with
http://<link>/pvt/serice.pwd
?

in ruby

Code: [Select]

require 'net/http'
while x = gets
begin
    puts x if Net::HTTP.get_response(x.chomp, '/pvt/serice.pwd').is_a? Net::HTTPSuccess
rescue
end; end

run it:

Code: [Select]

~/code/rb $ ./httpcheck < hosts.txt > good.txt


[neusbeer]

Gonna test this one..
Ruby is rather new for me.  looks not to harshe.. thnxs

[xzid]

ruby is the lang I'm currently learning[~week], I already prefer it to python/perl. Seems you can hack stuff together very quickly which is exactly what I like(C is a different thing altogether)

... although in some ways it's unlike anything else I code, so I find it interesting.

[neusbeer]

looks alot like perl.. can be ancestors or such..

[Flikka]

could you help me with this?


I'm not a python-er-person,
so, how would i run this?

[Kulverstukas]

save it on a computer. If windows save where you installed Python. Open up the CMD (Terminal for linux/mac). Navigate to where you saved the script, write:
python checkLinks.py

Follow instruction from there.

[imation]

OH very nice, thak you. this will make life easier