Page 1 of 1
Export all URLs
Posted: Wed Jan 31, 2007 10:24 am
by iFindURL
I know under the "List/Edit URLs" we can view all of the URLs crawled by Webinator. Is there a way we can easily export those URLs to some sort of file? excel or .csv? I've been copying and pasting them from the "Ordered by URL" view. It keeps crashing my computer.
Export all URLs
Posted: Wed Jan 31, 2007 10:42 am
by mark
From a shell/msdos prompt you could select them out of the database (the database path is listed in walk status).
texis -d DATABASE_PATH -s "select Url from html" >urllist.txt
Export all URLs
Posted: Wed Jan 31, 2007 10:53 am
by iFindURL
Is there anyway to pull the server status code with this list of URLs? I'm trying to find how many URLs are using 301 and 302 redirects. Thank you
Export all URLs
Posted: Wed Jan 31, 2007 11:59 am
by mark
Redirect statuses aren't recorded.