Web Fetching related scripts & softwares
Sitescooper automatically retrieves the stories from several news websites, trims off extraneous HTML, and converts them into formats you can read on your Palm computing device for later reading on-the-move. It maintains a cache, and will avoid stories you've already read. It can handle 1-page sites, 1-page with diffing, 2-level and 3-level sites, and it's very easy to add a new site to its list. Even if you don't have a Palm handheld, it's still handy for simple website-to-text conversion.
Finance::Quote is a perl module that fetches delayed on-line stock quotes. The Finance::Quote can fetch quote from a variety of sources, including the NYSE, the ASX, and a number of European exchanges.
This script searches in a particular newsgroup for postings and extracts posted urls. newsurl prints a list containing author, subject and posted urls for each posting containing urls. You can specify filters for the subject and/or the author. So you can minimize the download. Optionally a html-output can be generated.
quote is a very short and simple Perl script that retrieves stock quotes from Yahoo! Finance. It's a clean and fast command-line interface for getting snapshot stock market prices. It uses the Perl LWP module if available, or lynx otherwise.
This script allows you to fetch a specified Web page using HTTP, FTP and GOPHER, and parses it for links counting them as it goes. With multiple sites it will calculate the average links per webpage. The script requires the Win32::Internet module.
This script fetches the backend file from The Linux Review server every 60 minutes (default) and saves it locally. On request, the local file is read and healines printed in a formatted manner. The script is useful for including headlines in html pages.
Webget is a Perl script that downloads a list of specified URLs at night. It is only useful if you do not have to pay on a per-minute scale for your Internet connection;its advantages are that you will reach higher speeds with most ISPs, and you do not have to download while you are using your Internet connection for other things too. It consists of two files: a CGI-script that makes a database from a list of URL's that you enter with your browser, and a Perl-script that parses the database and calls wget to download all files.
Dtheatre News Grabber is a CGI/Perl script that allows you to fetch the newest Digital Theater news headlines. It comes with a few customizable features. It requires IO::Socket and IO::Handle modules.
This is a simple Perl script that takes a list of books and looks to see if they are considered published on fatbrain. It requires the LWP module.
This simple PHP script allows you to capture the headlines of Geeknews.Org and prints as HTML page.
|
