Url lists

melvint9 · Post by **melvint9** » Thu Oct 18, 2001 8:42 am

Good Morning,

I have a list of urls on a page that I want to crawl, but it's saved as a .cfm file (which is coldfusion). I tried the command (gw -fcfm -D2 "&links.cfm), but I keep receiving "protocol disallowed. I also tried crawling a url list within the url address for example I tried (gw -fcfm -D2 http://localhost/pko/links.cfm)but it only visits the 1 page. Do I have to save the url list as a txt or list file for it to work.

Melvin

Post by **mark** » Thu Oct 18, 2001 10:06 am

List files must be local files and contain just urls, no html. If it's a web file it must be html with href's, not raw urls. You may use any extension as long as you give the corresponding -f option as you have.