getting pages walked per base url

[KMandalia]

I want to generate a report that will give me no. of pages walked per base url.

I am not quite sure if webinator saves base urls somewhere and if it doesn't,the only way to get the base urls is to do some rex filtering so that I only get back the string upto the first '/'.

Let me know how I can query the html table "efficiently" that would give me the accurate no. of pages walked per base url.

CAN TESTDB AND OPTIONS TABLE HELP?

[KMandalia]

ok,

what would be the name of the setting that I would use to pull the base urls from options table in the testdb for my profile?

[mark]

SSc_url

Hint: On the settings page look at the url for the ? next to a setting. At the end there's #h_SETTINGNAME

[KMandalia]

got it.

thanks for the hint !

[mark]

Also, the settings in multi-line boxes generally need extra processing. See dowalk's applysettings function for how it processes them. eg SSc_url needs to be broken up into a list:
<split nonempty "\space+" $SSc_url></split>
<$SSc_url=$ret>
Then you can loop over them with
<loop $SSc_url>
...
</loop>

[KMandalia]

Trying to get no. of pages walked per base url. I must be doing something wrong. Can you point it out for me?

<script language=vortex>
<timeout=-1></timeout>
<a name=main public urllisting mydb>
<SQL "select String from options where Profile='myprofile' and Name='SS_db'"></sql>
<$mydb=$string>
<SQL "select String from options where Profile='myprofile' and Name='SSc_url'"></sql>
<$urllisting=$string>
<split nonempty "\space+" $urllisting></split>
<$urllisting=$ret>
<loop $urllisting>
$urllisting
<sql db=$mydb "select count(*) No from html where Url matches '%$urllisting%'">
$urllisting,$No
</sql>
</loop>
</a>
</script>

[KMandalia]

thanks, John.

It did the job. Very Cool.

[KMandalia]

if I split the base url as explained and then take out the http://www. part of it out and if I then do the following

<sort $urllisting>
<$urllisting=$ret>

it doesn't sort... What am I doing wrong?

[mark]

Doesn't sort? As in leaves the items in the order they were in before? We'd have to see your code and the result to know why.

[KMandalia]

As suspected, it was my mistake. I was sorting them after I break the variable in pieces. I have it fixed now.


however there is one minor problem, which I don't think there will be a solution. I am removing http://www part of the url but when the url doesn't have http://www. but has http://somedomain it wouldn't sort it correctly.

But that's alright for the time being.