Is there a way to make Webinator ignore images?

Post Reply
lbneal
Posts: 17
Joined: Sat Jun 19, 2010 9:52 pm

Is there a way to make Webinator ignore images?

Post by lbneal »

The bandwidth load on the target and the storage load on the walker is huge when all the useless images are downloaded during a walk.

How to stop downloading images while walking?

I have looked for such a method but failed to find it in the documentation.
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

Is there a way to make Webinator ignore images?

Post by mark »

If you have "All extensions" turned on turn it off and specify only the extensions you want in the "Extensions" setting.
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

Is there a way to make Webinator ignore images?

Post by mark »

Or you can add unwanted extensions to the exclusion list.

Or you can, if the webserver will respect it, set "Mime types" to only those you want instead of the default of */* which accepts everything. Some more common mime types:
text/html
text/plain
application/pdf
application/msword

The "application" ones won't be useful with the free version as it doesn't have the file formats plugin.
lbneal
Posts: 17
Joined: Sat Jun 19, 2010 9:52 pm

Is there a way to make Webinator ignore images?

Post by lbneal »

Information appreciated I will give it a shot.
lbneal
Posts: 17
Joined: Sat Jun 19, 2010 9:52 pm

Is there a way to make Webinator ignore images?

Post by lbneal »

No indication of success....

I tried:

text/html
text/plain

And Exclusions --

/cgi-bin
.jpg
.gif
~

No reported change in behavior...
User avatar
mark
Site Admin
Posts: 5513
Joined: Tue Apr 25, 2000 6:56 pm

Is there a way to make Webinator ignore images?

Post by mark »

If you're doing a refresh walk the exclusions won't affect pages already in the database. Use Profile Tools->List/Edit URLs to delete the unwanted URLs.
Or set rewalk type to New.
Post Reply