Hi,
I'm crawling a large list of single URL's using either the single page option or base URL with maximum depth at 0.
To get maximum speed, what is a safe number I could increase the 'server' option to?
I'm crawling a large list of single URL's using either the single page option or base URL with maximum depth at 0.
To get maximum speed, what is a safe number I could increase the 'server' option to?