I suspect I have been had

Post Reply
lbneal
Posts: 17
Joined: Sat Jun 19, 2010 9:52 pm

I suspect I have been had

Post by lbneal »

Webinator looks to be great, but then fails to deliver?

There are great features but a basic walk is next to impossible to accomplish?

I have spent some several hours trying to get a basic walk against a specific site without success.

Who would pay $5800+ for a broken platform?
User avatar
John
Site Admin
Posts: 2597
Joined: Mon Apr 24, 2000 3:18 pm
Location: Cleveland, OH
Contact:

I suspect I have been had

Post by John »

Webinator has successfully crawled hundreds of thousands of sites. Some sites may require some configuration, which we are happy to help out with if you can point us at the site, or provide more information.
John Turnbull
Thunderstone Software
lbneal
Posts: 17
Joined: Sat Jun 19, 2010 9:52 pm

I suspect I have been had

Post by lbneal »

I have walked some 5+ sites that are essentially clones of each other. They all use the same CMS package.

I see We responses such as this:

"1,516 pages visited in the last hour (200 success/1,316 failed)" but no details of those "errors"?

On another site I get 1035 successful walks and maybe 5 or 6 errors?

The first site has 3000+ articles but only ~44 appear in the walk database?

The other sites walked have wildly varying results for no obvious reason.
User avatar
jason112
Site Admin
Posts: 347
Joined: Tue Oct 26, 2004 5:35 pm

I suspect I have been had

Post by jason112 »

> "1,516 pages visited in the last hour
> (200 success/1,316 failed)" but no details
> of those "errors"?

The Walk Status page, where you saw that count, shows the 10 most recent errors. There's also a "View Errors" link at the bottom of the Walk Status page.

Note that "error" can mean a wide variety of things with high verbosity. Every reason a URL isn't included is logged as an error - Linking to an offsite page, an unwanted extension, etc. These aren't actual problems with the site, but they will help us understand why pages that should be included in the crawl aren't (as seems to be the case).
lbneal
Posts: 17
Joined: Sat Jun 19, 2010 9:52 pm

I suspect I have been had

Post by lbneal »

The issues are slowly being eliminated.

Thanks for the assistance and information.
Post Reply