running many gw simultaneously

Post Reply
User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

running many gw simultaneously

Post by Thunderstone »



How can I run many gw on one database with the same options?

first time I run for example:

gw -mlv.set -ddb "&url.lst"

what is the right syntax if:
1. gw process is accidently stopped with power off or Ctrl+C
2. I would like to run additional gw to speed process

in both situations I would like to keep all settings defined in .set and =
lst files.

thank You,
edmunds=20



User avatar
Thunderstone
Site Admin
Posts: 2504
Joined: Wed Jun 07, 2000 6:20 pm

running many gw simultaneously

Post by Thunderstone »




Just run the second gw with the same command line except for the url list.
they will both work off of the same todo list. Also make sure you're using
-w0 if you want to walk as fast as possible.

If you interrupt gw with ^C, it will exit nicely at the first safe
moment. If you power off while it's running, you risk corrupting your
database.


Post Reply