Include cgi-bin URLs

[Phill-26]

I'd like to include URLs that contain cgi-bin and as this is a default exlcusion I am removing it from the exclusion box in walk settings but the walk status page is still saying it will ignore cgi-bin URLs.
I am only using single page walks and have noticed it is walking some cgi-bin URLs but missing some others.

Any thoughts appreciated.

[mark]

You might want to do a mode "new" walk to get a clean slate instead of "refresh".
Also make sure robots.txt on that site doesn't exclude cgi-bin. If it does you can turn off robots.txt in the walk settings.