/
 | ./ | |
| includes/ | |
 | README.txt [source] [16 lines] | |
| browse.php [source] [81 lines] | |
| config.php [source] [60 lines] | Crawler Configuration File |
| crawl.php [source] [179 lines] | Main crawler function. Can be run manually or via cron. Append "?debug" to URL for verbose output, but performance will degrade over time (as browser buffer fills) |
| export.php [source] [88 lines] | Include necessary files |
| stats.php [source] [200 lines] | File to output the Crawler's current progress to the browser |