Show Posts

This section allows you to view all posts made by this member. Note that you can only see posts made in areas you currently have access to.


Messages - xtream1101

Pages: [1]
1
Scripting Languages / Re: Download all ebooks from it-ebooks.info
« on: October 29, 2014, 05:04:30 pm »
I re codded about the whole script to work better.
Now when the site is parsed, it will save all the book/page data to a .json file. When Parsed again, it will only pars what the .json file is missing, as in it will get anything new

The download section will use the .json file for all of its needs.

I changed the way it worked so we are not sending un-needed traffic.

2
Scripting Languages / Python Script Manager with API
« on: October 28, 2014, 04:01:54 pm »
Script Control: https://github.com/xtream1101/ScriptControl
This was created in python 3 using flask to manage other python scripts over an api. The reason for this is that I run a lot of scripts on my server to automate various tasks and I wanted an easy way to manage all of them.

Web Control Interface: https://github.com/xtream1101/control-interface
This is a modular style web interface where one of the default modules will control the python control script. With this interface, you will see that you can create any web app and add it to the interface.

**Both of these projects are still a work in progress so you may encounter some bugs. If you do please let me know and I will do my best to correct them.

-x

3
Scripting Languages / Re: Starting Python scripting - Setting up a Python environment
« on: October 27, 2014, 02:30:26 pm »
+1 for PyCharm for the best Python IDE

4
Found it on the Webs / Re: 3 days with no sun light?
« on: October 26, 2014, 03:16:12 pm »
More info on this topic:
http://www.iflscience.com/space/no-nasa-did-not-predict-global-blackout-december

This link is from the article above which has more info:
http://www.snopes.com/science/astronomy/blackout.asp

5
Found it on the Webs / Re: 3 days with no sun light?
« on: October 24, 2014, 11:59:57 pm »
I started to read the nasa.gov article, then I read...
Quote
Elenin will pass about 22 million miles (35 million kilometers) from Earth during its closest approach on Oct. 16, 2011.

Did anyone find out any other info regarding the original article?

6
Scripting Languages / Re: Download all ebboks from it-ebooks.info
« on: October 24, 2014, 07:43:31 pm »
Quote from: Fur on October 24, 2014, 07:38:42 pm
it-ebooks has an API. I would have used that instead. After all, JSON is easier to parse, the API returns only the data we need, and the entire point in the API was to help other programs get content from it-ebooks.
It would just be a matter of calling http://it-ebooks-api.info/v1/book/$i for all $i from 0 to the id of the last uploaded book and parsing the result.

I was going to do that but something seems to be broken with it.
When i do http://it-ebooks-api.info/v1/book/1 it should give me the book that is at http://it-ebooks.info/book/1/.
But instead I get {"Error":"Book not found!"}

7
Scripting Languages / Re: Download all ebboks from it-ebooks.info
« on: October 24, 2014, 06:12:57 pm »
Just so I can understand better, what part of this code is "complicated?"
Also I don't see how using requests will make the code any shorter, it would just be used in place of where I use urllib woulden't it?

8
Scripting Languages / Re: Download all ebboks from it-ebooks.info
« on: October 24, 2014, 04:53:47 pm »
Quote from: s3my0n on October 24, 2014, 04:47:31 pm
You should automatically move them to directories based on the topic.

For right now that will have to wait as I cannot get the topic of the book from the page I am parsing (http://it-ebooks.info/book/1/). But I will find a way to look up the book and get that info when I get time. For now I will make them go into their publisher directory.


9
Scripting Languages / Re: Download all ebboks from it-ebooks.info
« on: October 24, 2014, 03:41:46 pm »
I did read about requests when making this script, but I have been trying to keep my scripts as dependent as possible.

10
Scripting Languages / Download all ebooks from it-ebooks.info
« on: October 24, 2014, 03:27:03 pm »
I created this script to download all of the ebooks from it-ebooks.info. This may not be useful to many as it will download them all. I just like having offline copies of everything.

Here is the GitHub repo with the most up to date code: https://github.com/xtream1101/it-ebooks-dl

Edit: took out code block, most recent script is linked above.

Pages: [1]