The pid showing up is 9160 and last several lines are (this is going on for last 6 hours, I tried doing pauses every 45 seconds, 9160 is not showing up anywhere on the page):
started 3 new (11760) on
http://www.cunalendingcouncil.org/download/
Dispatcher stopping by request. May take up to 65 seconds to stop.
123246 pages fetched (-1,987,327,543 bytes) Total
114858 errors Total
34930 duplicate pages Total
Removing commonality from fetched pages...Reading urls from URL
http://www.creditunions.com/getarchive.aspx
Reading urls from URL
http://www.creditunions.com/resources/a ... leases.asp
Reading urls from URL
http://www.creditunions.com/resources/a ... report.asp
Walker holding by request. (
http://www.bai.org)
482 pages fetched (67,608,105 bytes) from
http://www.bai.org
Reading urls from URL
http://www.creditunions.com/getarchive.aspx
Reading urls from URL
http://www.creditunions.com/resources/a ... leases.asp
Reading urls from URL
http://www.creditunions.com/resources/a ... report.asp
Walker holding by request. (
http://www.cunatechnologycouncil.org/)
31 pages fetched (1,097,407 bytes) from
http://www.cunatechnologycouncil.org/
Reading urls from URL
http://www.creditunions.com/getarchive.aspx
Reading urls from URL
http://www.creditunions.com/resources/a ... leases.asp
Reading urls from URL
http://www.creditunions.com/resources/a ... report.asp
166 pages fetched (25,039,688 bytes) from
http://www.cunalendingcouncil.org/download/
Show Errors