The logs indicate the walks completed, and can you please explain the searches.
Webinator help
-
- Posts: 22
- Joined: Thu Feb 05, 2004 11:45 am
Webinator help
All the searches are working.
Webinator help
Since gw doesn't background itself or linger after completion the zombies must be the result of shell or system defects. I'm not sure what to suggest if the system won't release the executables when they finish. I guess you'll just have to kill them at the end of the run. You could add something like this to the end of your shell script:
ps -ef | grep webinator/bin/gw | nawk '{system("kill " $2);}'
ps -ef | grep webinator/bin/gw | nawk '{system("kill " $2);}'
Webinator help
One interesting thing to note however is that the system seems to be ignoring the setuid bits in the perms because gw is setuid to steve but the zombie procs are owned by root.
-
- Posts: 22
- Joined: Thu Feb 05, 2004 11:45 am
Webinator help
Is it because the script is run by root in the crontab.
Webinator help
The setuid bit should make the programs run as steve, not root. You could try running the script as steve instead of root though.
-
- Posts: 22
- Joined: Thu Feb 05, 2004 11:45 am
Webinator help
I am sending a copy of a rewalk.srn, is this mean it is complete?
200 Database created
Enabling extra duplicate prevention
Getting http://204.64.105.28/robots.txt...Got it...Ok.
http://window.state.tx.us/comptrol/san/statewise/
0/0^M1/0^M1/0^M1/1^M1/2^M1/3^M1/4^M1/5^M1/6^M1/7^M1/8
Visited 1 pages total
Indexing new pages
Rewalking database
200 Database created
Enabling extra duplicate prevention
Getting http://204.64.105.28/robots.txt...Got it...Ok.
http://window.state.tx.us/comptrol/san/statewise/
0/0^M1/0^M1/0^M1/1^M1/2^M1/3^M1/4^M1/5^M1/6^M1/7^M1/8
Visited 1 pages total
Indexing new pages
Rewalking database
Webinator help
It appears you pasted it incorrectly. The "Rewalking database" would be the first line, not the last. But otherwise, yes that appears complete. It only walked one page, but that's a different issue altogether.