I'm receiving the following errors while trying to index one of our =
sites, this particular tree has ~500 pages in it. Webinator is running =
on a Sun Ultra enterprise II running solaris 2.5.1. Most of the =
indexing works correctly, it seems to be failing after indexing ~300 =
links...
Any help would be greatly appreciated....
The command I am running is
gw -mwebopts -dnysbk =
http://ecf-bk-secure/cgi-bin/DocketSheet.pl?96-50401
where webopts contains
-----------------------
# run dnscache once, after creating database
# dnscache
# Max size of page indexed is 200K=20
z200000
# set debug level (0 is off except for errors).
v9
#Wait x seconds between retrieving pages
w0
#Wait x seconds before giving up on a page
t99
# index URL's which contain cgi-bin in their path
C
napplication/pdf,pdf,/home10/webinator/bin/pdftotx
# use file as log file=20
l/home10/webinator/web.log
y
-----------------------------
the error's I am receiving are:
-----------------------------
Link: http://ecf-bk-secure/cgi-bin/show_case_doc?99,5501
1: TotLinks: 452, Links: 452/ 1, Good: 311, New: 310 Lookup
1: TotLinks: 452, Links: 452/ 1, Good: 311, New: 310 Todo
1: TotLinks: 452, Links: 452/ 1, Good: 311, New: 311 Adding =
Reference
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
http://ecf-bk-secure/cgi-bin/show_case_doc?345,5501
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311 Retrieving
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
000 socket: Too many open files
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
000 Can't connect to ecf-bk-secure:80: Too many open files
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
100 Open failed, Too many open files, trying again
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
.
.
.
002 can't open /home10/webinator/nysbk/SYSLOCKS: Too many open files
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
000 Could not open locking mechanism
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
000 Could not connect to /home10/webinator/nysbk
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
115 Can't open error database. Errors will not be logged to it.
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
http://ecf-bk-secure/cgi-bin/show_case_doc?344,5501
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311 Retrieving
1: TotLinks: 452, Links: 452/ 0, Good: 311, New: 311
000 socket: Too many open files
-------------------------------