haskell.org is so fragile
Today I have observed that hackage.haskell.org/ timeout twice (in the noon and in the evening.) What is the problem? Is it that haskell users have increased so that haskell.org is overloaded? That's very good news. I am eager to donate some money if it requires server reinforcement. Sincerely, -- Takayuki MURANUSHI The Hakubi Center for Advanced Research, Kyoto University http://www.hakubi.kyoto-u.ac.jp/02_mem/h22/muranushi.html
Hi, On 12/07/2012 13:06, Takayuki Muranushi wrote:
Today I have observed that hackage.haskell.org/ timeout twice (in the noon and in the evening.)
What is the problem? Is it that haskell users have increased so that haskell.org is overloaded? That's very good news. I am eager to donate some money if it requires server reinforcement.
The issue is unfortunately more to do with sysadmin resources than server hardware; there's noone with the time to actively manage the server and make sure that it's running well. Any ideas for improving the situation would be gratefully received. Today there were some problems with some processes taking up a lot of resources. One of the problems was the hackage search script, which has been disabled for now. Cheers, Ganesh
Hello Is there some kind of nagios or similar monitoring software in place? In my experience that really helps when you don't have time to check the servers all the time, especially since it is easy to write small custom plugins for additional checks (e.g. on some of our work servers I have one of those that checks dmesg for kernel oops messages, one to check if the running version of our software is the same as the installed version,...). Matthias Hörmann
On 07/12/2012 11:04 PM, Ganesh Sittampalam wrote:
Hi,
On 12/07/2012 13:06, Takayuki Muranushi wrote:
Today I have observed that hackage.haskell.org/ timeout twice (in the noon and in the evening.)
What is the problem? Is it that haskell users have increased so that haskell.org is overloaded? That's very good news. I am eager to donate some money if it requires server reinforcement.
The issue is unfortunately more to do with sysadmin resources than server hardware; there's noone with the time to actively manage the server and make sure that it's running well. Any ideas for improving the situation would be gratefully received.
Today there were some problems with some processes taking up a lot of resources. One of the problems was the hackage search script, which has been disabled for now.
Since I don't have insight into the "inner sanctum" (aka. "service/server setup") this may be way off base, but how about adding a Varnish instance in front of haskell.org and its various subdomains? It could cache everything for 5 minutes (unconditional) and reduce load by ridiculous amounts. Regards,
It would have to be rewritten in Haskell and called Harnish.
Gaius
------------------
-----Original Message-----
From: Bardur Arantsson
Hi,
On 12/07/2012 13:06, Takayuki Muranushi wrote:
Today I have observed that hackage.haskell.org/ timeout twice (in the noon and in the evening.)
What is the problem? Is it that haskell users have increased so that haskell.org is overloaded? That's very good news. I am eager to donate some money if it requires server reinforcement.
The issue is unfortunately more to do with sysadmin resources than server hardware; there's noone with the time to actively manage the server and make sure that it's running well. Any ideas for improving the situation would be gratefully received.
Today there were some problems with some processes taking up a lot of resources. One of the problems was the hackage search script, which has been disabled for now.
Since I don't have insight into the "inner sanctum" (aka. "service/server setup") this may be way off base, but how about adding a Varnish instance in front of haskell.org and its various subdomains? It could cache everything for 5 minutes (unconditional) and reduce load by ridiculous amounts. Regards, _______________________________________________ Haskell-Cafe mailing list Haskell-Cafe@haskell.org http://www.haskell.org/mailman/listinfo/haskell-cafe
Hello,
The issue is unfortunately more to do with sysadmin resources than server hardware; there's noone with the time to actively manage the server and make sure that it's running well. Any ideas for improving the situation would be gratefully received.
I don't know about the current architecture of Hackage. But what about this: the main server concentrates on registration/uploading and mirrors serve queries/downloading. Yesterday some Japanese Haskellers used a mirror server: http://hackage.haskell.biz/ --Kazu
participants (6)
-
Bardur Arantsson -
Gaius Hammond -
Ganesh Sittampalam -
Kazu Yamamoto -
Matthias Hörmann -
Takayuki Muranushi