format for text URL files

b.sims · Post by **b.sims** » Wed Dec 10, 2003 10:38 am

I've specified a URL as a URL file; it is a PHP script which outputs text. URLs are seperated by line feed/carriage return.

However, running from the command line execution hangs. Looking at walk status there is the following error:

Reading urls from http://ioc.unesco.org/oceanportal/listAll.php
http://gcmd.gsfc.nasa.gov

011 d:/web-root/webinator/dowalk(toptodo) 2551: Cannot insert into B-tree D:\MORPH3\texis\oceanportal\db2\xtodourl.btr: Value too large in the function btinsert
http://gcmd

Then the same error many times over. I'm assuming something wrong with the text file format (I have run from local text files in the past without problem).

Post by **mark** » Wed Dec 10, 2003 11:05 am

URL file must be a local file on disk. You want URL URL. Your format sounds correct.

Post by **mark** » Wed Dec 10, 2003 11:11 am

p.s.
That page has some invalid urls with space in them. Space should be encoded as %20 or +. The urls listed in a text/plain file should also not include any anchors (#).

b.sims · Post by **b.sims** » Thu Dec 11, 2003 8:48 am

I had URL URL, I typed incorrectly.

I have taken out the anchors and spaces look ok, but I still get the same errors.

Post by **mark** » Thu Dec 11, 2003 10:21 am

I'm not able to replicate your problem. Are you doing a "new" walk? What other non-default settings are you using?

Try downloading the latest dowalk and webinatoradamin scripts from the webinator examples page.