spell checker

card
Posts: 10
Joined: Thu Jan 04, 2007 2:57 pm

spell checker

Post by card »

A couple of times I've had walks fail when they tried to create a spell checker. Since I don't really need a spell checker; is there anyway to disable it? Thanks.
card
Posts: 10
Joined: Thu Jan 04, 2007 2:57 pm

spell checker

Post by card »

Never mind - I found it. Thanks.
card
Posts: 10
Joined: Thu Jan 04, 2007 2:57 pm

spell checker

Post by card »

I turned off Spell Check in the Search settings, but the walk is still failing when trying to create spell checking dictionaries.

from walk status:
Creating search index on fetched pages...Done.
Creating spell-checker dictionaries...

Can I disable the creation of spell checker dictionaries? Thanks.
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

spell checker

Post by mark »

One question is in what way is the dictionary creation failing? It shouldn't be.

You can disable it by editing dowalk. After the line
<a name=createdict private>
add a line reading
<return>

[Note: Scripts on the appliance are not editable. The suggestion to edit was given because this thread was started in the Webinator group. It has now been moved to the Appliance group.]
card
Posts: 10
Joined: Thu Jan 04, 2007 2:57 pm

spell checker

Post by card »

The error message on the device was:
_alloc_pages: 0-order allocation failed (gfp=0x1d2/0)
vm: killing process texis

I have a linux appliance and I don't think that I have the access needed to edit dowalk, as you describe above. Interaction with the device is mostly limited to the GUI interface. My admin password doesn't give me access to the Thunderstone Tech logon.
card
Posts: 10
Joined: Thu Jan 04, 2007 2:57 pm

spell checker

Post by card »

The spell checker dictionary was finally written. The crawl was 167,000 pages and took about 5 hours; but writing the spell checker dictionary took 12 hours. I wasn't expecting it to take that long.
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

spell checker

Post by mark »

Ok. Correct. You can't edit scripts on the appliance. You had posted to the Webinator group so the advice was incorrect for the Appliance. I've moved this message to the proper group.

It looks like your appliance ran out of memory while the dictionary was being created. Did you have other large or many crawls going at the same time?

In any event creating the dictionary shouldn't take that long unless the system is under particularly heavy load. Do you have any custom "word expressions"?