[Summary view] [Print] [Text view]

   1  TO USE:
   2  
   3  1. Edit config.PHP with appropriate database and domain information
   4  2. (for now) in phpMyAdmin insert the seed URL into the urls table.
   5      * URL should be www.
   6      * URL should have a trailing slash
   7      * (for now) May also want to set clicks to '0' to avoid problems 
   8  3. Open crawler.php
   9  4. (optional) open stats.php to watch progress
  10  
  11  TIPS:
  12      Changes to php.ini
  13          1. Increase memory limit (1GB)
  14          2. Remove execution time limit
  15      Changes to mysql.ini
  16          * Increased max query size (to avoid "mysql went away" error)