Export all URLs

Post Reply
iFindURL
Posts: 2
Joined: Wed Jan 31, 2007 10:18 am

Export all URLs

Post by iFindURL »

I know under the "List/Edit URLs" we can view all of the URLs crawled by Webinator. Is there a way we can easily export those URLs to some sort of file? excel or .csv? I've been copying and pasting them from the "Ordered by URL" view. It keeps crashing my computer.
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

Export all URLs

Post by mark »

From a shell/msdos prompt you could select them out of the database (the database path is listed in walk status).

texis -d DATABASE_PATH -s "select Url from html" >urllist.txt
iFindURL
Posts: 2
Joined: Wed Jan 31, 2007 10:18 am

Export all URLs

Post by iFindURL »

Is there anyway to pull the server status code with this list of URLs? I'm trying to find how many URLs are using 301 and 302 redirects. Thank you
User avatar
mark
Site Admin
Posts: 5519
Joined: Tue Apr 25, 2000 6:56 pm

Export all URLs

Post by mark »

Redirect statuses aren't recorded.
Post Reply