Scalability at GROU.PS Presentation Notes
Fri 16 Oct 2009 08:57:10 | 2 comments
Things to bing (or google if you want to):
nginx, libevent, memcache, danga interactive, gearman, mogilefs, nosql, cassandra, hive, hadoop, scribe, thrift, maatkit (for mysql), mmm (for mysql)
MySQL useful settings:
query_cache_size = 0 # on master
query_cache_type = 0 # on master
thread_concurrency = 8 # total cores
max_connections = 750 # shouldn’t exceed that
innodb_buffer_pool_size = 10G # a little less than the total amount
And our typical sysctl additions; as I've promised - the configuration that lets us serve 1PB per month to 3 million unique visitors:
net.ipv4.tcp_syncookies
= 1
net.ipv4.tcp_synack_retries
= 2
## Emre edited
#
http://www.oracle-base.com/articles/11g/OracleDB11gR1InstallationOnFedora8.php
kernel.shmall = 2097152
kernel.shmmax = 2147483648
kernel.shmmni = 4096
# semaphores: semmsl, semmns, semopm, semmni
kernel.sem = 250
32000 100 128
net.ipv4.ip_local_port_range
= 1024 65000
net.core.rmem_default=4194304
#net.core.rmem_max=4194304
net.core.wmem_default=262144
#net.core.wmem_max=262144
fs.file-max=5049800
vm.swappiness=10
## Emre edited
# from
http://forums.softlayer.com/showthread.php?t=3252
net.ipv4.tcp_rmem =
4096 87380 8388608
net.ipv4.tcp_wmem =
4096 87380 8388608
net.core.rmem_max = 8388608
net.core.wmem_max = 8388608
net.core.netdev_max_backlog = 5000
net.ipv4.tcp_window_scaling
= 1
net.ipv4.ip_nonlocal_bind=1
#
http://rackerhacker.com/2007/08/24/apache-no-space-left-on-device-couldnt-create-accept-lock/
kernel.msgmni = 1024
kernel.sem = 250
256000 32 1024
net.ipv4.ip_conntrack_max
= 524288
net.ipv4.netfilter.ip_conntrack_max
= 524288
Comments
Hidayet Dogan 4 months ago
Emre Sokullu 4 months ago
or
