I couldn’t sleep last night. I’m worried we’ll lose this client.<\/p>\n
So just to be clear. I wasn’t part of the crew responsible for scaling this site. I had already set up a scalable architecture for the site, that would automatically and horizontally scale at Amazon<\/a>. That idea got shot down for legal reasons that to my surprise haven’t been in play for awhile. Can we say, “Office politics?”<\/p>\n I totally recommend Amazon’s Autoscaling to anybody that’s new to this.<\/p>\n Instead of auto-scaling, the site was architected by a local San Francisco firm who I won’t mention here.<\/p>\n Let’s just hope enough people read this so that they won’t even have to know the name of the company and will just know the smell of an un-scaleable architecture.<\/p>\n Scalability requirement: 100,000 concurrent users<\/p>\n This is how they set it up:<\/p>\n If they had even googled ‘building scalable websites’<\/a> they would have come across a book that would have avoided all of this, Cal Henderson’s Building Scalable Websites<\/a>. It should be mandatory reading for anybody working on a large website, and it just scratches the surface.<\/p>\n So, how did we get to 600 concurrent users?<\/p>\n We tweaked mysql by putting this in \/etc\/m.cnf:<\/p>\n We ran siege and were able to get to about 300 concurrent users without breaking a sweat, but now apache was dying.<\/p>\n So we tweaked apache. We started out with this:<\/p>\n StartServers 8 And ended up with this:<\/p>\n RAM and CPU were doubled.<\/p>\n","protected":false},"excerpt":{"rendered":" I couldn’t sleep last night. I’m worried we’ll lose this client. So just to be clear. I wasn’t part of the crew responsible for scaling this site. I had already set up a scalable architecture for the site, that would automatically and horizontally scale at Amazon. That idea got shot down for legal reasons that […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[4,288],"tags":[],"class_list":["post-658","post","type-post","status-publish","format-standard","hentry","category-how-to","category-scalability-hacking"],"_links":{"self":[{"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/posts\/658","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/comments?post=658"}],"version-history":[{"count":0,"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/posts\/658\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/media?parent=658"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/categories?post=658"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.codebelay.com\/blog\/wp-json\/wp\/v2\/tags?post=658"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}\n
\nmax_connections=10000
\nquery_cache_size=50000000
\nthread_cache_size=16
\nthread_concurrency=16 # only works on Solaris and is ignored on other OSes\n<\/div>\n
\nMinSpareServers 5
\nMaxSpareServers 20
\nServerLimit 256
\nMaxClients 256
\nMaxRequestsPerChild 4000<\/p>\n
\nMinSpareServers 50
\nMaxSpareServers 200
\nServerLimit 256
\nMaxClients 256
\nMaxRequestsPerChild 4000\n<\/div>\n