The crawl started with resume, got 40 of these types of errors, cranked along slowly (~500 pages per hour)
then hit the process memory limit, Here is what is says after that limit. What is the issue? The crawl seems to keep going just slowly.
2008-05-29 06:11:57 Process memory limit exceeded (current: 700,018,688; limit: 700,000,000) (2387)
1797 pages fetched (2,147,483,647 bytes) from http://literature.rockwellautomation.co ... egory.hcst took 20 hours 5 minutes 59 seconds
2008-05-29 06:26:02 started 1 (23862) Resume 483c45671b
Using primer: http://literature.rockwellautomation.co ... egory.hcst
005 /usr/local/morph3/texis/scripts/dowalk(procpage) 4056: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(procpage) 4056: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(procpage) 4056: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(proclinks) 3688: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(proclinks) 3688: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
then hit the process memory limit, Here is what is says after that limit. What is the issue? The crawl seems to keep going just slowly.
2008-05-29 06:11:57 Process memory limit exceeded (current: 700,018,688; limit: 700,000,000) (2387)
1797 pages fetched (2,147,483,647 bytes) from http://literature.rockwellautomation.co ... egory.hcst took 20 hours 5 minutes 59 seconds
2008-05-29 06:26:02 started 1 (23862) Resume 483c45671b
Using primer: http://literature.rockwellautomation.co ... egory.hcst
005 /usr/local/morph3/texis/scripts/dowalk(procpage) 4056: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(procpage) 4056: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(procpage) 4056: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(proclinks) 3688: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English
005 /usr/local/morph3/texis/scripts/dowalk(proclinks) 3688: Bad size 279123982 for column Ref before offset 0x4 in recid 0x0 of (temp RAM DBF) in the function pbuftofld while processing url http://literature.rockwellautomation.co ... %20English