How To find and retrieve files quickly on the WWW.

Last updated: Friday, November 06, 1998

Most are familiar with MS Explorer or Netscape. Common locations like Tucows, Strouds, Search, and many more, where we can find and download software. However, at certain times the web becomes busy and the process becomes slow. In addition, simply finding a file can take a very long time.

FTP sites, using programs like cuteFTP or WS-FTP, are as fast and often faster when the web slows down, and a much better way than email to send large files if one has an ftp site available.
** CuteFTP will resume broken downloads where possible.

The problem, if it is one, is that as you move away from the browsers, you will need to know a little more about the file you want as descriptions are minimal with FTP and other methods which follow.
As the net becomes flooded with information, it is becoming more critical to learn how to use some of the following tools, unless you prefer to spend hours and never find what you want.


Searching the Web Update !

Ferret software is low cost and excellent - Web Ferret Pro for pages, File Ferret Pro for files. They produce a suite of programs - the search engines are painful when you find 10000 related pages and you have to wait ages for commercials and the next 20.
Web Ferret allows you to select what engines to use - and no commercials.
File Ferret searches selectable FTP sites and will permit direct downloads and resume broken downloads assuming this is supported at the FTP site. See Net Vampire for general file retrieval.

File Retrieval Update !

Net Vampire is freeware - use for downloading files - the primary idea here is that you can schedule and files will resume if partial - not all sites support resuming broken downloads but most do. Ever tried to download from Geocities? 10 attempts to get a 300k file and then give up in frustration? Use Vampire and you won't look back.
Why do some authors write freeware? A pretty good resume when you think about it. The Russian author of Vampire came to Canada recently - instant job.
Gopher is a client/server system that allows internet navigation without the previous confusing language and terminology. Gophers are menu-driven; no commands are needed to access the information. Gopher systems are designed like trees, with branches continuing with more information. Have not tried Gopher yet!
Archie is a gigantic database of all the files that are known to be available to the public by ftp (file transfer protocol). Archie clients allow you to search for specific files; you get a list of the sites that have files that match your request. Later you can ftp to these sites to download the files.

Two typical Archie programs for win95 are fpArchie and WsArch32. fpArchie has an ftp program built in, so slightly preferable to me, although both are quite good.

Archie programs will permit searches on archie servers. In general pick one close - there are at least 2 in Canada, but you may get different results when you search on different ones.

With fpArchie you can click on the file you are looking for and it will be retrieved. Quite often the same file will be available from several sites. Again select the closest site to you for the quickest download. With WsArchie, you are dropped to your specified FTP program to download.

Experiment with either Archie program, and if you are impressed, read on.


An Archie program (in fact the Archie server) will search the internet for you.

The next phase does not require an Archie program. You simply send an email to the Archie server and have the results mailed back to you!

To learn how - simply email archie@archie.mcgill.ca, and in the body of your email just put the word "help" (no subject and no quotation marks). In return mail you will get a help file on how to use the Archie. (at Mcgill in this case)

If you want a list of all servers known to the McGill server, send another letter with the word "servers" instead of help.

NOTE: use "archie@" in front of the server address. It would also be wise to get the help file from any of the servers you wish to access, in case of differences.

Example Search:

Email a message to your archie:
To: archie.mcgill.ca (for instance)(archie@archie.mcgill.ca)
Subject: (nothing in this field)
Body: set search sub (substrings too)
set maxhits 140 (max 140 hits)(100-1000)
set maxhitspm 9 (not the same file all over)
find snap32 (we want this)

** all files with snap32 within its name will be returned via email (not the file, just the locations) - refer to the help file on how to define searches.**

- could be a few minutes. If more than a day refer to the help file.

***From the returned list, you can then ftp to the site where your file is, and retrieve it.***


The following was returned from McGill on the 29 Apr 1997 using "servers"

--------------------< List of active archie servers >--------------------
Last Update: Feb 18 1997
  • archie.au
  • 139.130.23.2 Australia
  • archie.univie.ac.at
  • 131.130.1.23 Austria
  • archie.belnet.be
  • 193.190.198.2 Belgium
  • archie.bunyip.com
  • 192.77.55.5 Canada
  • archie.cs.mcgill.ca
  • 132.206.51.250 Canada
  • archie.funet.fi
  • 128.214.248.46 Finland
  • archie.cru.fr
  • 129.20.254.2 France
  • archie.th-darmstadt.de
  • 130.83.22.1 Germany
  • archie.ac.il
  • 132.65.208.15 Israel
  • archie.unipi.it
  • 131.114.21.15 Italy
  • archie.wide.ad.jp
  • 133.4.3.6 Japan
  • archie.kornet.nm.kr
  • 168.126.63.10 Korea
  • archie.sogang.ac.kr
  • 163.239.1.11 Korea
  • archie.nz
  • 140.200.128.20 New Zealand
  • archie.icm.edu.pl
  • 148.81.209.5 Poland
  • archie.rediris.es
  • 130.206.1.5 Spain
  • archie.luth.se
  • 130.240.12.23 Sweden
  • archie.switch.ch
  • 193.5.24.1 Switzerland
  • archie.ncu.edu.tw
  • 192.83.166.12 Taiwan
  • archie.doc.ic.ac.uk
  • 193.63.255.1 UK
  • archie.hensa.ac.uk
  • 129.12.200.130 UK
  • archie.unl.edu
  • 129.93.1.14 USA (NE)
  • archie.internic.net
  • 198.49.45.10 USA (NJ)
  • archie.internic.net
  • 204.159.111.101 USA (VA)
  • archie.internic.net
  • 204.179.186.65 USA (NJ)
  • archie.rutgers.edu
  • 128.6.21.13 USA (NJ)
  • archie.ans.net
  • 147.225.1.10 USA (NY)

    YOU HAVE HAD A COMPUTER SEARCH FOR YOU WHEN YOU WERE OFF LINE, AND KIND ENOUGH TO RETURN THE RESULTS TO YOU BY EMAIL! (NO HUMAN INTERVENTION)
    NOW FOR YET ANOTHER PHASE - ASKING ANOTHER COMPUTER TO EMAIL YOU THE FILE!

    Instead of Archie servers, we will use an FTPMAIL server.

    When you receive the results of your search, you can cut and paste the file info into another email and mail it to an FTPMAIL server.

    NOTE: A file larger than 102K will typically be split, therefore you have to know how to join these split files when received. Expect at least a day or so for the file to arrive.

    A program decoder.zip (15K) will uudecode the email - but, you must join all parts if more than one, with a text editor and remove all headers.

    Test conditions using win95 and pegasus mail. File requested was snap32.exe (407K). The received email was 570K when joined and uuencoded.

    1. Did not specify size and received a 6 part email .
    2. Pegasus could not uudecode the attachment.
    3. Joined all with a text editor, deleted headers, and used decoder.
    4. Result failed - can only conclude that one or more of the parts were corrupt.
    5. Repeated specifying 512K and compress.
    6. Received 2 parts, joined, removed headers, used decoder.
    7. Worked this time - removing headers was required.
    8. Note: file was not compressed - compress may require a modifier.

    NOTE: Email encoding typically increases file size by more than 40 per cent!

    One server is ftpmail@doc.ic.ac.uk. Send an email to them with just "help" in the body, and you will receive a help file explaining the commands you can use. This is typical of most ftpmail servers. Some support 512K size, most limit size to 102K.

    The following is an example file request from this server. ** you will receive a confirmation before you get the file - requires no action unless you wish to cancel the request.

    To: ftpmail@doc.ic.ac.uk (for instance)
    Subject: (leave blank)
    Body: reply-to [email addr] (optional) used ONLY if file is to be returned to
    an address different than your default
    open space.mit.edu (the command is [open] )
    (a location the archie found)
    If [help] or [delete jobid]
    no other lines should follow
    cd pub/mydir (go to the correct subdir) (as per Archie search results)
    mode binary (prepare for BINARY) (optional) you can specify [ascii]
    default is binary
    get snap32.exe (I want this)
    size num[K|M] (default is 102K) if you do not specify max file size
    the file will be split to 102K
    max split size is 102K
    or 512K if from ftpmail@doc.ic.ac.uk
    compress (optional) you can have the file compressed
    before it is sent to you
    mime (optional) default is uuencode
    quit (bye)
    Get the HELP file for clarification and other optional commands!

    ...................First you will receive a confirmation, then the file....................

    Here are some other FTPMAIL servers -
    Europe.
    ftpmail@doc.ic.ac.uk using ftpmail 1.23
    ftpmail@grasp.insa-lyon.fr using ftpmail 1.23
    (experimental) restrictions
    ftpmail@ftp.sunet.se using ftpmail 1.20.
    ftpmail@ftp.uni-stuttgart.de using ftpmail 1.20
    with local mods.
    Restrictions: ls -R disabled.
    ftpmail@ieunet.ie using Squirrel Mail Server
    Software V3.01B
    ftpmail@archie.inesc.pt using ftpmail 1.??. Restrictions: Accessible only from
    portuguese nodes (under .pt).
    ftpmail@ftp.luth.se using ftpmail 1.??.
    USA
    ftpmail@decwrl.dec.com
    ftpmail@census.gov using ftpmail 1.20.
    ftpmail@ftp.Dartmouth.EDU using ftpmail 1.19.
    ftpmail@sunsite.unc.edu using ftpmail 1.19
    ftpmail@ftp.SHSU.edu using ftpmail 1.19. Restrictions: primarily intended for access
    to the Comprehensive TeX Archive
    Network (CTAN) on ftp.SHSU.edu.
    Australia
    ftpmail@cs.uow.edu.au

    Software. ftpmail by Lee McLoughlin