Re: Proposal: splitting the network package

On 18 January 2013 00:50, Bryan O'Sullivan wrote:

On Thu, Jan 17, 2013 at 8:38 AM, Conrad Parker wrote:

...

c'mon, it's not like anyone needs to go parsing billions of URIs in a hurry.

This is not even a bit true, I'm afraid. I have run into innumerable cases where libraries low in some language's stack, but on a hot code path, were slow enough to dramatically affect both latency and throughput. The URI handling code in network would be a prime instance of that.

Indeed. I was being a little bit facetious: the problem of parsing billions of URIs comes up fairly often in web crawling. Conrad.