Server Optimization Request [DB & Front]

  • Hey,

    We recently upgraded our VB hosting platform into the following and I would your help to tweak the system.

    1. 2 x Dedicated.

    2. Servers specs:

    MySQL Server Specs:
    HP ProLiant DL360 G4
    CPU: 2 x Intel Xeon Woodcrest 5120 (1.86GHz)
    RAM: 4GB
    HDD: SATA, 2x80GB, RAID 1, 10,000RPM
    OS: Fedora Core 6, Kernel 2.6.19, x86_64
    MySQL: 5.0.27
    Apache Server Specs (Front):
    HP ProLiant DL140 G3
    CPU: 2 x Intel Xeon Woodcrest 5110 (1.60GHz)
    RAM: 2GB
    HDD: SATA, 2x80GB, RAID 1, 7,200RPM
    OS: Fedora Core 6, Kernel 2.6.19, x86_64
    Apache: 2.2.4
    PHP: 5.1.6
    eAccelerator v0.9.5 3. VB Version: 3.6.1

    4. not using any InnoDB.

    5. yum install mysql, rpm.

    6. TOPs
    Apache PHP front - Server TOP:
    top - 13:37:07 up 68 days, 4 min, 2 users, load average: 1.38, 1.48, 1.46
    Tasks: 217 total, 2 running, 214 sleeping, 0 stopped, 1 zombie
    Cpu0 : 5.3%us, 1.0%sy, 0.0%ni, 63.3%id, 30.0%wa, 0.0%hi, 0.3%si, 0.0%st
    Cpu1 : 10.6%us, 1.3%sy, 0.0%ni, 82.5%id, 5.3%wa, 0.0%hi, 0.3%si, 0.0%st
    Cpu2 : 7.6%us, 1.3%sy, 0.0%ni, 87.4%id, 3.3%wa, 0.0%hi, 0.3%si, 0.0%st
    Cpu3 : 42.5%us, 3.0%sy, 0.0%ni, 39.5%id, 8.3%wa, 0.3%hi, 6.3%si, 0.0%st
    Mem: 2053868k total, 2010752k used, 43116k free, 5384k buffers
    Swap: 2031608k total, 94836k used, 1936772k free, 1002568k cached

    PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
    15472 apache 15 0 277m 19m 6452 S 7 1.0 0:00.91 httpd
    15396 apache 15 0 278m 22m 8556 S 7 1.1 0:01.72 httpd
    15414 apache 15 0 279m 24m 10m S 6 1.2 0:02.68 httpd
    15864 apache 15 0 278m 21m 7460 S 5 1.1 0:00.86 httpd
    15409 apache 16 0 280m 23m 9.8m S 4 1.2 0:02.07 httpd
    15435 apache 15 0 278m 23m 9616 S 4 1.2 0:01.31 httpd
    15921 apache 15 0 278m 20m 6564 S 3 1.0 0:00.27 httpd
    15897 apache 15 0 277m 19m 7412 S 3 1.0 0:00.89 httpd
    15449 apache 15 0 278m 21m 7884 S 2 1.1 0:01.59 httpd
    15840 apache 15 0 278m 23m 9608 S 2 1.2 0:01.12 httpd
    15865 apache 15 0 277m 19m 6392 S 2 1.0 0:00.67 httpd
    15902 apache 15 0 277m 18m 5576 S 2 0.9 0:00.31 httpd
    15388 apache 15 0 278m 21m 7544 S 2 1.1 0:01.27 httpd
    15460 apache 16 0 278m 20m 6596 S 2 1.0 0:01.08 httpd
    15852 apache 15 0 278m 21m 7636 S 1 1.1 0:00.59 httpd
    15918 apache 15 0 276m 16m 5224 S 1 0.8 0:00.04 httpd
    14777 apache 15 0 278m 22m 8396 S 1 1.1 0:04.32 httpd
    15331 apache 15 0 278m 20m 7256 S 1 1.0 0:02.49 httpd
    15479 apache 15 0 278m 22m 9260 S 1 1.1 0:02.24 httpd
    15857 apache 16 0 277m 18m 5992 S 1 0.9 0:00.46 httpd
    15866 apache 15 0 277m 19m 6400 S 1 1.0 0:00.43 httpd
    15911 apache 15 0 276m 17m 5452 S 1 0.9 0:00.19 httpd
    15427 root 15 0 12704 1180 796 R 1 0.1 0:00.93 top
    492 root 10 -5 0 0 0 S 0 0.0 27:58.10 kjournald
    14350 apache 15 0 278m 23m 9.8m S 0 1.2 0:03.71 httpd
    15869 apache 15 0 278m 20m 6556 S 0 1.0 0:01.89 httpd
    15875 apache 15 0 278m 20m 6352 S 0 1.0 0:00.72 httpd
    15898 apache 15 0 278m 21m 7240 S 0 1.1 0:00.49 httpd
    15915 apache 15 0 276m 17m 5416 S 0 0.9 0:00.14 httpd
    2235 landrove 15 0 39924 1660 1164 R 0 0.1 6:44.82 vsftpd
    1 root 15 0 10304 460 424 S 0 0.0 0:05.44 init
    2 root RT 0 0 0 0 S 0 0.0 1:21.77 migration/0
    3 root 34 19 0 0 0 S 0 0.0 0:30.37 ksoftirqd/0
    4 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/0
    5 root RT 0 0 0 0 S 0 0.0 28:20.57 migration/1
    6 root 34 19 0 0 0 S 0 0.0 0:17.87 ksoftirqd/1
    7 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/1
    8 root RT 0 0 0 0 S 0 0.0 0:03.54 migration/2
    9 root 34 19 0 0 0 S 0 0.0 0:00.22 ksoftirqd/2
    10 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/2
    11 root RT 0 0 0 0 S 0 0.0 0:03.03 migration/3
    12 root 34 19 0 0 0 S 0 0.0 0:00.54 ksoftirqd/3
    13 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/3
    14 root 10 -5 0 0 0 S 0 0.0 0:02.14 events/0
    15 root 10 -5 0 0 0 S 0 0.0 0:01.79 events/1
    16 root 10 -5 0 0 0 S 0 0.0 0:01.57 events/2
    [root@front1 conf]#
    MySQL Server TOP:
    top - 13:40:29 up 75 days, 2:48, 3 users, load average: 0.26, 0.18, 0.17
    Tasks: 110 total, 1 running, 108 sleeping, 1 stopped, 0 zombie
    Cpu0 : 17.4%us, 2.8%sy, 0.0%ni, 77.1%id, 1.4%wa, 0.2%hi, 1.1%si, 0.0%st
    Cpu1 : 4.3%us, 0.8%sy, 0.0%ni, 93.9%id, 0.9%wa, 0.0%hi, 0.0%si, 0.0%st
    Cpu2 : 12.1%us, 1.7%sy, 0.0%ni, 86.1%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
    Cpu3 : 6.3%us, 1.2%sy, 0.0%ni, 92.5%id, 0.1%wa, 0.0%hi, 0.0%si, 0.0%st
    Mem: 4038116k total, 3535112k used, 503004k free, 454904k buffers
    Swap: 2031608k total, 0k used, 2031608k free, 2343828k cached

    PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND
    29731 mysql 15 0 711m 224m 3968 S 6 5.7 1131:06 mysqld
    30218 root 16 0 12608 1056 792 R 1 0.0 0:00.01 top
    1 root 15 0 10308 684 568 S 0 0.0 0:05.07 init
    2 root RT 0 0 0 0 S 0 0.0 0:11.37 migration/0
    3 root 34 19 0 0 0 S 0 0.0 0:00.48 ksoftirqd/0
    4 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/0
    5 root RT 0 0 0 0 S 0 0.0 0:05.73 migration/1
    6 root 34 19 0 0 0 S 0 0.0 0:01.06 ksoftirqd/1
    7 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/1
    8 root RT 0 0 0 0 S 0 0.0 0:09.22 migration/2
    9 root 34 19 0 0 0 S 0 0.0 0:00.23 ksoftirqd/2
    10 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/2
    11 root RT 0 0 0 0 S 0 0.0 0:08.68 migration/3
    12 root 34 19 0 0 0 S 0 0.0 0:00.33 ksoftirqd/3
    13 root RT 0 0 0 0 S 0 0.0 0:00.00 watchdog/3
    14 root 10 -5 0 0 0 S 0 0.0 0:00.08 events/0
    15 root 10 -5 0 0 0 S 0 0.0 0:00.02 events/1
    16 root 10 -5 0 0 0 S 0 0.0 0:00.00 events/2
    17 root 10 -5 0 0 0 S 0 0.0 0:00.00 events/3
    18 root 10 -5 0 0 0 S 0 0.0 0:00.00 khelper
    19 root 11 -5 0 0 0 S 0 0.0 0:00.00 kthread
    26 root 10 -5 0 0 0 S 0 0.0 0:00.26 kblockd/0
    27 root 10 -5 0 0 0 S 0 0.0 0:00.41 kblockd/1
    28 root 10 -5 0 0 0 S 0 0.0 0:00.01 kblockd/2
    29 root 10 -5 0 0 0 S 0 0.0 0:00.03 kblockd/3
    30 root 17 -5 0 0 0 S 0 0.0 0:00.00 kacpid
    144 root 17 -5 0 0 0 S 0 0.0 0:00.00 cqueue/0
    145 root 18 -5 0 0 0 S 0 0.0 0:00.00 cqueue/1
    146 root 17 -5 0 0 0 S 0 0.0 0:00.00 cqueue/2
    147 root 19 -5 0 0 0 S 0 0.0 0:00.00 cqueue/3
    150 root 10 -5 0 0 0 S 0 0.0 0:00.00 khubd
    [root@db1 ~]#
    7. my.cnf

    [root@db1 ~]# cat /etc/my.cnf
    [mysqld]
    datadir=/var/lib/mysql
    socket=/var/lib/mysql/mysql.sock
    # Default to using old password format for compatibility with mysql 3.x
    # clients (those using the mysqlclient10 compatibility package).
    old_passwords=1
    set-variable = max_connections=500

    ## DONT RESOLVE DOMAINS
    skip-external-locking
    skip-name-resolve
    skip-innodb
    skip-bdb

    bind-address = 0.0.0.0

    #
    # * Fine Tuning
    #
    thread_stack = 128K
    #
    # * Query Cache Configuration
    #
    query_prealloc_size = 65536
    query_alloc_block_size = 131072
    default-storage-engine = MyISAM

    key_buffer = 256M
    myisam_sort_buffer_size = 64M
    join_buffer = 1M
    read_buffer_size = 2M
    sort_buffer_size = 2M
    read_rnd_buffer_size = 1M
    record_buffer = 1M
    table_cache = 2048
    thread_cache_size = 32
    tmp_table_size = 32M
    max_allowed_packet = 160M
    max_connect_errors = 10
    query_cache_limit = 3M
    query_cache_size = 96M
    query_cache_type = 1
    thread_concurrency = 8
    interactive_timeout=100

    # Here you can see queries with especially long duration
    log-slow-queries = /var/log/mysql-slow.log
    long_query_time = 1

    #
    # The following can be used as easy to replay backup logs or for replication.
    #server-id = 1
    #log-bin = /var/log/mysql/mysql-bin.log
    #expire-logs-days = 7
    max_binlog_size = 104857600
    #binlog-do-db = include_database_name
    #binlog-ignore-db = include_database_name

    [mysqldump]
    quick
    max_allowed_packet = 16M

    [mysql.server]
    user=mysql
    basedir=/var/lib

    [mysqld_safe]
    open_files_limit = 8192
    log-error=/var/log/mysqld.log
    pid-file=/var/run/mysqld/mysqld.pid

    [myisamchk]
    key_buffer = 64M
    sort_buffer = 64M
    read_buffer = 16M
    write_buffer = 16M
    8. MySQL Stats

    MySQL Stats, full var, ver ext, etc.. (http://landroverz.com/work/.vbulletin.com/mysql_stats.html)
    Uptime: 443034 Threads: 10 Questions: 64769440 Slow queries: 6 Opens: 1388 Flush tables: 1 Open tables: 383 Queries per second avg: 146.195
    mysqladmin Ver 8.41 Distrib 5.0.27, for redhat-linux-gnu on x86_64
    (C) 2000 MySQL AB & MySQL Finland AB & TCX DataKonsult AB
    This software comes with ABSOLUTELY NO WARRANTY. This is free software,
    and you are welcome to modify and redistribute it under the GPL license

    Server version 5.0.27-log
    Protocol version 10
    Connection Localhost via UNIX socket
    UNIX socket /var/lib/mysql/mysql.sock
    Uptime: 5 days 3 hours 3 min 54 sec

    Threads: 10 Questions: 64769440 Slow queries: 6 Opens: 1388 Flush tables: 1 Open tables: 383 Queries per second avg: 146.195

    mysqlreport
    [root@db1 ~]# ./mysqlreport --all
    MySQL 5.0.27-log uptime 5 3:8:23 Sat May 26 13:48:51 2007

    __ Key __________________________________________________ _______________
    Buffer used 70.81M of 256.00M %Used: 27.66
    Current 74.29M %Usage: 29.02
    Write ratio 0.617
    Read ratio 0.000

    __ Questions __________________________________________________ _________
    Total 64.82M 146.2/s
    DMS 28.48M 64.2/s %Total: 43.93
    +Unknown 14.91M 33.6/s 23.01
    QC Hits 13.40M 30.2/s 20.67
    Com_ 4.02M 9.1/s 6.20
    COM_QUIT 4.01M 9.0/s 6.19
    Slow 286 0.0/s 0.00 %DMS: 0.00
    DMS 28.48M 64.2/s 43.93
    SELECT 20.34M 45.9/s 31.38 71.44
    UPDATE 7.54M 17.0/s 11.63 26.47
    INSERT 469.60k 1.1/s 0.72 1.65
    DELETE 65.64k 0.1/s 0.10 0.23
    REPLACE 61.05k 0.1/s 0.09 0.21
    Com_ 4.02M 9.1/s 6.20
    change_db 4.01M 9.0/s 6.18
    show_fields 2.80k 0.0/s 0.00
    show_status 2.78k 0.0/s 0.00

    __ SELECT and Sort __________________________________________________ ___
    Scan 6.36M 14.3/s %SELECT: 31.26
    Range 2.73M 6.2/s 13.43
    Full join 758.92k 1.7/s 3.73
    Range check 0 0/s 0.00
    Full rng join 0 0/s 0.00
    Sort scan 8.07M 18.2/s
    Sort range 1.72M 3.9/s
    Sort mrg pass 11.94k 0.0/s

    __ Query Cache __________________________________________________ _______
    Memory usage 15.61M of 96.00M %Used: 16.26
    Block Fragmnt 19.12%
    Hits 13.40M 30.2/s
    Inserts 8.35M 18.8/s
    Insrt:Prune 8.35M:1 18.8/s
    Hit:Insert 1.60:1

    __ Table Locks __________________________________________________ _______
    Waited 95.60k 0.2/s %Total: 0.50
    Immediate 18.88M 42.6/s

    __ Tables __________________________________________________ ____________
    Open 383 of 2048 %Cache: 18.70
    Opened 1.39k 0.0/s

    __ Connections __________________________________________________ _______
    Max used 109 of 500 %Max: 21.80
    Total 4.01M 9.0/s

    __ Created Temp __________________________________________________ ______
    Disk table 26.09k 0.1/s
    Table 3.74M 8.4/s
    File 10.90k 0.0/s

    __ Threads __________________________________________________ ___________
    Running 2 of 6
    Cached 26 of 32 %Hit: 99.98
    Created 822 0.0/s
    Slow 0 0/s

    __ Aborted __________________________________________________ ___________
    Clients 1.93k 0.0/s
    Connects 1.48k 0.0/s

    __ Bytes __________________________________________________ _____________
    Sent 1.96T 4.4M/s
    Received 17.68G 39.9k/s

    __ InnoDB Buffer Pool __________________________________________________
    Usage 0 of 0 %Used: 0.00
    Read ratio 0.000
    Pages
    Free 0 %Total: 0.00
    Data 0 0.00 %Drty: 0.00
    Misc 0 0.00
    Latched 0 0.00
    Reads 0 0/s
    From file 0 0/s 0.00
    Ahead Rnd 0 0/s
    Ahead Sql 0 0/s
    Writes 0 0/s
    Flushes 0 0/s
    Wait Free 0 0/s

    __ InnoDB Lock __________________________________________________ _______
    Waits 0 0/s
    Current 0
    Time acquiring
    Total 0 ms
    Average 0 ms
    Max 0 ms

    __ InnoDB Data, Pages, Rows ____________________________________________
    Data
    Reads 0 0/s
    Writes 0 0/s
    fsync 0 0/s
    Pending
    Reads 0
    Writes 0
    fysnc 0

    Pages
    Created 0 0/s
    Read 0 0/s
    Written 0 0/s

    Rows
    Deleted 0 0/s
    Inserted 0 0/s
    Read 0 0/s
    Updated 0 0/s
    9. Vb 3.6.1 only. but with some mods.

    10. ~1500, 1800 cookie time.

    11. phpinfo FRONT
    phpinfo.html (http://landroverz.com/work/.vbulletin.com/phpinfo.html)
    eAccelerator v0.9.5 installed.12. Apache settings (FRONT):
    Apache settings:
    StartServers 8
    MinSpareServers 5
    MaxSpareServers 20
    ServerLimit 256
    MaxClients 256
    MaxRequestsPerChild 4000 13. no big files found.

    14. 3 commands output (identical for both servers, mysql+front)
    uname -a
    Linux front1 2.6.19-1.2911.6.5.fc6 #1 SMP Sun Mar 4 16:05:34 EST 2007 x86_64 x86_64 x86_64 GNU/Linux
    ulimit -aH
    core file size (blocks, -c) unlimited
    data seg size (kbytes, -d) unlimited
    max nice (-e) 0
    file size (blocks, -f) unlimited
    pending signals (-i) 16376
    max locked memory (kbytes, -l) 32
    max memory size (kbytes, -m) unlimited
    open files (-n) 1024
    pipe size (512 bytes, -p) 8
    POSIX message queues (bytes, -q) 819200
    max rt priority (-r) 0
    stack size (kbytes, -s) unlimited
    cpu time (seconds, -t) unlimited
    max user processes (-u) 16376
    virtual memory (kbytes, -v) unlimited
    file locks (-x) unlimited

    cat /proc/cpuinfo
    MySQL Server:
    processor : 0
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5120 @ 1.86GHz
    stepping : 6
    cpu MHz : 1866.737
    cache size : 4096 KB
    physical id : 0
    siblings : 2
    core id : 0
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall lm constant_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr lahf_lm
    bogomips : 3737.26
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    processor : 1
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5120 @ 1.86GHz
    stepping : 6
    cpu MHz : 1866.737
    cache size : 4096 KB
    physical id : 3
    siblings : 2
    core id : 0
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall lm constant_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr lahf_lm
    bogomips : 3733.77
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    processor : 2
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5120 @ 1.86GHz
    stepping : 6
    cpu MHz : 1866.737
    cache size : 4096 KB
    physical id : 0
    siblings : 2
    core id : 1
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall lm constant_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr lahf_lm
    bogomips : 3733.59
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    processor : 3
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5120 @ 1.86GHz
    stepping : 6
    cpu MHz : 1866.737
    cache size : 4096 KB
    physical id : 3
    siblings : 2
    core id : 1
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall lm constant_tsc pni monitor ds_cpl vmx est tm2 cx16 xtpr lahf_lm
    bogomips : 3733.55
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    Apache - Front Server:
    processor : 0
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5110 @ 1.60GHz
    stepping : 6
    cpu MHz : 1595.973
    cache size : 4096 KB
    physical id : 0
    siblings : 2
    core id : 0
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
    bogomips : 3193.51
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    processor : 1
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5110 @ 1.60GHz
    stepping : 6
    cpu MHz : 1595.973
    cache size : 4096 KB
    physical id : 3
    siblings : 2
    core id : 0
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
    bogomips : 3191.44
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    processor : 2
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5110 @ 1.60GHz
    stepping : 6
    cpu MHz : 1595.973
    cache size : 4096 KB
    physical id : 0
    siblings : 2
    core id : 1
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
    bogomips : 3191.48
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:

    processor : 3
    vendor_id : GenuineIntel
    cpu family : 6
    model : 15
    model name : Intel(R) Xeon(R) CPU 5110 @ 1.60GHz
    stepping : 6
    cpu MHz : 1595.973
    cache size : 4096 KB
    physical id : 3
    siblings : 2
    core id : 1
    cpu cores : 2
    fpu : yes
    fpu_exception : yes
    cpuid level : 10
    wp : yes
    flags : fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush dts acpi mmx fxsr sse sse2 ss ht tm syscall nx lm constant_tsc pni monitor ds_cpl vmx tm2 ssse3 cx16 xtpr dca lahf_lm
    bogomips : 3191.43
    clflush size : 64
    cache_alignment : 64
    address sizes : 36 bits physical, 48 bits virtual
    power management:
    fffehew :)
    took a while to organize the data.

    Please help me out to tweak, the servers are strong I suspect the settings are slowing it down.

    Some notes:
    The forum currently has ~ 250,000 posts, growing on daily basis.
    The current ver of 3.6.1 is temp, I'm working on moving all the plugins and the design to a clean setup of 3.6.7 :D
    Couldn't post the "MySQL Stats" (#8) & phpinfo (#11) here inside a [code], got some weird DB error: see here (http://landroverz.com/work/.vbulletin.com/post_error.jpg), prolly was too long :). Anyhow, attached as external links.Regards,
    Oleg G.


  • Try the following in this exact order. You can ignore any of the suggestions that you have already done.

    1. Upgrade PHP to 5.2.2 or if you have problems install PHP 4.4.6 (in either case install as ISAPI module and NO CGI)
    2. Edit /etc/my.cnf and place the following mysql server settings in /etc/my.cnf and restart mysql server afterwards


    [mysqld]
    datadir=/var/lib/mysql
    socket=/var/lib/mysql/mysql.sock
    skip-name-resolve
    old_passwords
    back_log = 50
    skip-innodb
    max_connections = 500
    key_buffer = 384M
    myisam_sort_buffer_size = 64M
    join_buffer_size = 1M
    read_buffer_size = 1M
    sort_buffer_size = 3M
    table_cache = 1800
    thread_cache_size = 384
    wait_timeout = 35
    connect_timeout = 10
    tmp_table_size = 64M
    max_heap_table_size = 256M
    max_allowed_packet = 256M
    max_connect_errors = 10
    thread_concurrency = 4
    concurrent_insert = 2
    table_lock_wait_timeout = 35
    read_rnd_buffer_size = 1M
    bulk_insert_buffer_size = 8M
    query_cache_limit = 4M
    query_cache_size = 64M
    query_cache_type = 1
    query_prealloc_size = 131072
    query_alloc_block_size = 65536
    default-storage-engine = MyISAM

    [mysql.server]
    user=mysql
    basedir=/var/lib

    [mysqld_safe]
    log-error=/var/log/mysqld.log
    pid-file=/var/run/mysqld/mysqld.pid
    nice = -10
    open_files_limit = 8192

    [mysqldump]
    quick
    max_allowed_packet = 16M

    [myisamchk]
    key_buffer = 64M
    sort_buffer = 64M
    read_buffer = 16M
    write_buffer = 16M


    3. Install APC Cache lastest version from http://pecl.php.net/package/APC. Read install guide at http://www.vbulletin.com/forum/showthread.php?t=165367 OR try the alternative PHP caching software, Xcache which seems to be a bit faster than APC Cache - http://www.vbulletin.com/forum/showthread.php?t=213267

    4. Upgrade to vB 3.0.17 http://www.vbulletin.com/forum/showthread.php?t=209720 if you're on vB 3.0.xx or upgrade to vB 3.5.8 http://www.vbulletin.com/forum/showthread.php?t=221903 if you're on vB 3.5.x. Upgrade to vB 3.6.7 http://www.vbulletin.com/forum/showthread.php?t=229950 if you're on vB 3.6.x

    5. If you just upgraded to vB 3.5.x/3.6.x try to disable these 4 options:

    Admin CP -> vBulletin Options -> Forums Home Page Options -> Display Logged in Users?

    Admin CP -> vBulletin Options -> Forum Display Options (forumdisplay) -> Show Users Browsing Forums

    Admin CP -> vBulletin Options -> Thread Display Options -> Show Users Browsing Thread

    Admin CP -> vBulletin Options -> Message Searching Options -> Automatic Similar Thread search

    6. Edit httpd.conf values to following and restart apache

    KeepAlive: On
    MaxKeepAliveRequests: 100
    KeepAliveTimeout: 4
    MinSpareServers: 10
    MaxSpareServers: 15
    StartServers: 10
    MaxClients: 180
    MaxRequestsPerChild: 1000


    7. If you have split web + db servers, ensure web server has dual network cards as outlined at http://www.vbulletin.org/forum/showthread.php?t=111191

    8. Ensure vB admincp gzip is disabled since you already have Apache with mod_deflate which does the same thing


  • skip xcache and try APC Cache and compare with eaccelerator :)

    Done :)

    Installed APC over the other things, nice to see the datastore by default supported by vb :)
    Hope it would be more reliable than Xcache.

    Do you happen to have optimized config for my system's configuration?

    I currently use this:
    extension=apc.so
    apc.enabled=1
    apc.optimization=0
    apc.shm_segments=1
    apc.shm_size=128
    apc.ttl=7200
    apc.user_ttl=7200
    apc.num_files_hint=1024
    apc.enable_cli=1


    Thanks again :)


  • Also started getting error messages to my email after applying the SQL settings:


    MySQL Error: MySQL server has gone away Error Number : 2006
    Date: Wednesday, May 30th 2007 @ 07:41:17 PM

    raise wait_timeout in my.cnf by 60 second increments and restart mysql each time until that error message goes away

    as to eaccelerator vs APC cache vs Xcache just try each and see which is best for your site... I'd start with Xcache first especially if you require Zend Optimizer since APC Cache doesn't work with Zend Optimizer.


  • Also started getting error messages to my email after applying the SQL settings:


    MySQL Error: MySQL server has gone away Error Number : 2006
    Date: Wednesday, May 30th 2007 @ 07:41:17 PM


  • I've tried using Xcache, but it seems to have some issues.

    After about 3 hours running with Xcache I got an SMS saying the server is down.
    I tried to login but failed, I suspected it was the load avg. Called the NOC to reboot and after they did I could not find anything interesting about this on the logs of the apache, nothing.
    This have never happened before and I decided to keep a close watch on
    Xcache.

    After about 1 hour this happened again but this time I caught it on time
    and killed the apache while it was on 60 load avg. it jumped into this
    level in seconds, from 2.00 to 60.00 in seconds!

    xcache.ini:

    [xcache-common]
    zend_extension = /usr/lib64/php/modules/xcache.so

    ; required for >=php5.1 if you turn XCache on
    auto_globals_jit = Off

    [xcache.admin]
    xcache.admin.user = "****"
    ; paste the output of md5(”password”) below
    xcache.admin.pass = "****"

    [xcache]
    xcache.shm_scheme = "mmap"
    xcache.size = 80M
    xcache.count = 4
    xcache.slots = 8K
    xcache.ttl = 0
    xcache.gc_interval = 0
    xcache.var_size = 10M
    xcache.var_count = 1
    xcache.var_slots = 8K
    xcache.var_ttl = 0
    xcache.var_maxttl = 0
    xcache.var_gc_interval = 300
    xcache.test = Off
    xcache.readonly_protection = On
    xcache.mmap_path = "/tmp/xcache"
    xcache.coredump_directory = "/tmp/xcache-coredump/"
    xcache.cacher = On
    xcache.stat = On
    xcache.optimizer = Off
    After this, I decided to get back to eAccelerator, now everything works
    fine again..

    I tried enabling/disabling xcache.optimizer, lowering the size limit, var_size.. etc but the load avg just sky rocketing after a while no meter what I do. (tried versions 1.2.0 & 2.0.0-dev, both same result)
    ** also tried with datastore catch and without, same effect.

    Maybe there is something wrong with my Xcache config?

    Thanks for the support btw :)


  • skip xcache and try APC Cache and compare with eaccelerator :)


  • i only changed 2 things when i used APC

    apc.optimization=1

    and set mem size to 48 which is about all i needed memory wise


  • Try the following in this exact order. You can ignore any of the suggestions that you have already done.

    1. Upgrade PHP to 5.2.2 or if you have problems install PHP 4.4.6 (in either case install as ISAPI module and NO CGI)
    2. Edit /etc/my.cnf and place the following mysql server settings in /etc/my.cnf and restart mysql server afterwards

    done, thanks!

    3. Install APC Cache lastest version from http://pecl.php.net/package/APC. Read install guide at http://www.vbulletin.com/forum/showthread.php?t=165367 OR try the alternative PHP caching software, Xcache which seems to be a bit faster than APC Cache - http://www.vbulletin.com/forum/showthread.php?t=213267

    I currently run eAccelerator v0.9.5, shall I upgrade it to one of those?


    4. working on the upgrade already, thanks :)

    5. -

    6. done


    7. If you have split web + db servers, ensure web server has dual network cards as outlined at http://www.vbulletin.org/forum/showthread.php?t=111191

    Its connected directly with localip to the web. eth1 ==> eth1.

    8. Ensure vB admincp gzip is disabled since you already have Apache with mod_deflate which does the same thing
    done :)


    Overall the web seems to work better, thanks again :)







  • #If you have any other info about this subject , Please add it free.#
    Your name:
    E-mail:
    Telphone:

    Your comments:


    If you have any other info about Server Optimization Request [DB & Front] , Please add it free.