Welche Konfiguration ist korrekt?

sintec
Posts: 54
Joined: 2006-10-10 22:34

Welche Konfiguration ist korrekt?

Post by sintec »

Hallo Forengemeinde,

ich stehe derzeit vor einem sehr großem Problem. Auf meinem Rootserver herscht derzeit eine recht unübersichtliche Last an dem mysql-server. Ich habe schon mehrfache Konfigurationen ausprobiert, leider brachte mich keine davon zu einem angemessenem Erfolg.

Hier mal der Auszug aus dem Tuning Primer Script

Code: Select all

-- MYSQL PERFORMANCE TUNING PRIMER --
             - By: Matthew Montgomery -

MySQL Version 5.0.32-Debian_7etch5 x86_64

Uptime = 0 days 21 hrs 19 min 23 sec
Avg. qps = 35
Total Questions = 2690598
Threads Connected = 714

Warning: Server has not been running for at least 48hrs.
It may not be safe to use these recommendations

To find out more information on how each of these
runtime variables effects performance visit:
http://dev.mysql.com/doc/refman/5.0/en/server-system-variables.html
Visit http://www.mysql.com/products/enterprise/advisors.html
for info about MySQL's Enterprise Monitoring and Advisory Service

SLOW QUERIES
The slow query log is NOT enabled.
Current long_query_time = 10 sec.
You have 43 out of 2690619 that take longer than 10 sec. to complete
Your long_query_time may be too high, I typically set this under 5 sec.

BINARY UPDATE LOG
The binary update log is NOT enabled.
You will not be able to do point in time recovery
See http://dev.mysql.com/doc/refman/5.0/en/point-in-time-recovery.html

WORKER THREADS
Current thread_cache_size = 8
Current threads_cached = 6
Current threads_per_sec = 0
Historic threads_per_sec = 0
Your thread_cache_size is fine

MAX CONNECTIONS
Current max_connections = 2500
Current threads_connected = 714
Historic max_used_connections = 720
The number of used connections is 28% of the configured maximum.
Your max_connections variable seems to be fine.

MEMORY USAGE
Max Memory Ever Allocated : 11 G
Configured Max Per-thread Buffers : 38 G
Configured Max Global Buffers : 151 M
Configured Max Memory Limit : 38 G
Physical Memory : 3.84 G

Max memory limit exceeds 90% of physical memory

KEY BUFFER
Current MyISAM index space = 16 M
Current key_buffer_size = 125 M
Key cache miss rate is 1 : 1705
Key buffer fill ratio = 6.00 %
Your key_buffer_size seems to be too high.
Perhaps you can use these resources elsewhere

QUERY CACHE
Query cache is enabled
Current query_cache_size = 16 M
Current query_cache_used = 5 M
Current query_cache_limit = 1 M
Current Query cache Memory fill ratio = 36.20 %
Current query_cache_min_res_unit = 4 K
MySQL won't cache query results that are larger than query_cache_limit in size

SORT OPERATIONS
Current sort_buffer_size = 15 M
Current read_rnd_buffer_size = 256 K
Sort buffer seems to be fine

JOINS
Current join_buffer_size = 132.00 K
You have had 1 queries where a join could not use an index properly
You should enable "log-queries-not-using-indexes"
Then look for non indexed joins in the slow query log.
If you are unable to optimize your queries you may want to increase your
join_buffer_size to accommodate larger joins in one pass.

Note! This script will still suggest raising the join_buffer_size when
ANY joins not using indexes are found.

OPEN FILES LIMIT
Current open_files_limit = 65535 files
The open_files_limit should typically be set to at least 2x-3x
that of table_cache if you have heavy MyISAM usage.
Your open_files_limit value seems to be fine

TABLE CACHE
Current table_cache value = 31512 tables
You have a total of 180 tables
You have 374 open tables.
The table_cache value seems to be fine

TEMP TABLES
Current max_heap_table_size = 16 M
Current tmp_table_size = 32 M
Of 14585 temp tables, 1% were created on disk
Effective in-memory tmp_table_size is limited to max_heap_table_size.
Created disk tmp tables ratio seems fine

TABLE SCANS
Current read_buffer_size = 128 K
Current table scan ratio = 16388 : 1
You have a high ratio of sequential access requests to SELECTs
You may benefit from raising read_buffer_size and/or improving your use of indexes.

TABLE LOCKING
Current Lock Wait ratio = 1 : 11
You may benefit from selective use of InnoDB.
If you have long running SELECT's against MyISAM tables and perform
frequent updates consider setting 'low_priority_updates=1'
If you have a high concurrency of inserts on Dynamic row-length tables
consider setting 'concurrent_insert=2'.


Hier der Auszug meiner my.cf ohne Kommentare

Code: Select all

[client]
port      = 3306
socket      = /var/run/mysqld/mysqld.sock

[mysqld_safe]
socket      = /var/run/mysqld/mysqld.sock
nice      = 0

[mysqld]
user      = mysql
pid-file   = /var/run/mysqld/mysqld.pid
socket      = /var/run/mysqld/mysqld.sock
port      = 3306
basedir   = /usr
datadir   = /var/lib/mysql
tmpdir      = /tmp
language   = /usr/share/mysql/english
skip-external-locking

key_buffer      = 125M
max_allowed_packet   = 16M
thread_stack      = 128K
thread_cache_size   = 8
max_connections      = 2500
table_cache          = 5MB
sort_buffer      = 15M
query_cache_limit       = 1M
query_cache_size        = 16M

[mysqldump]
quick
quote-names
max_allowed_packet   = 16M

[mysql]
#no-auto-rehash   # faster start of mysql but no tab completition

[isamchk]
key_buffer      = 16M

# [MYSQL_CLUSTER]
# ndb-connectstring=127.0.0.1
!includedir /etc/mysql/conf.d/



Hardware
Intel(R) Core(TM)2 Quad CPU Q6600 @ 2.40GHz
4096 Megabyte RAM
2x 250 SATA HDD's

Ich hoffe Ihr könnt mir evtl. einige Hilfreiche Tipps geben, was ich genau an der Konfiguration ändern soll.

Vielen Dank.

MfG,
Sintec
Top

Roger Wilco
Administrator
Administrator
Posts: 6001
Joined: 2004-05-23 12:53

Re: Welche Konfiguration ist korrekt?

Post by Roger Wilco »

Schon dein Slow Query Log aktiviert, mitlaufen lassen und die gefundenen Slow Queries abgegrast?
Top

User avatar
Joe User
Project Manager
Project Manager
Posts: 11519
Joined: 2003-02-27 01:00
Location: Hamburg

Re: Welche Konfiguration ist korrekt?

Post by Joe User »

Versuche es mal mit folgender my.cnf

Code: Select all

[client]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1
port                            = 3306
socket                          = /var/run/mysqld/mysqld.sock

[mysql]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1
prompt                          = u@h [d]>_
no_auto_rehash

[mysqladmin]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1

[mysqlcheck]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1

[mysqldump]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1
max_allowed_packet              = 32M
quote_names
quick

[mysqlimport]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1

[mysqlshow]
character_sets_dir              = /usr/share/mysql/charsets
default_character_set           = latin1

[isamchk]
character_sets_dir              = /usr/share/mysql/charsets
key_buffer_size                 = 256M

[myisamchk]
character_sets_dir              = /usr/share/mysql/charsets
key_buffer_size                 = 256M

[myisampack]
character_sets_dir              = /usr/share/mysql/charsets

[mysqld_safe]
err_log                         = /var/log/mysql/mysql.err

[mysqld]
character_sets_dir              = /usr/share/mysql/charsets
character_set_server            = latin1
default_character_set           = latin1
user                            = mysql
port                            = 3306
bind_address                    = 127.0.0.1
socket                          = /var/run/mysqld/mysqld.sock
pid_file                        = /var/run/mysqld/mysqld.pid
log_error                       = /var/log/mysql/mysqld.err
basedir                         = /usr
datadir                         = /var/lib/mysql
tmpdir                          = /var/tmp
slave_load_tmpdir               = /var/tmp
language                        = /usr/share/mysql/english
log_bin                         = /var/lib/mysql/mysql-bin
relay-log                       = /var/lib/mysql/relay.log
relay-log-index                 = /var/lib/mysql/relay.index
master-info-file                = /var/lib/mysql/master.info
relay-log-info-file             = /var/lib/mysql/relay.info
#master_host                     = <hostname>
#master_user                     = <username>
#master_password                 = <password>
#master_port                     = 3306
#auto_increment_increment        = 10
#auto_increment_offset           = 1
server_id                       = 1
back_log                        = 50
sync_binlog                     = 0
binlog_cache_size               = 1M
max_binlog_size                 = 100M
expire_logs_days                = 7
slave_compressed_protocol       = 1
lower_case_table_names          = 1
delay_key_write                 = ALL
safe_user_create                = 1
myisam_repair_threads           = 1
myisam_recover                  = FORCE,BACKUP
skip_locking
skip_name_resolve
skip_external_locking
skip_show_database
key_buffer_size                 = 512M
join_buffer_size                = 2M
sort_buffer_size                = 2M
read_buffer_size                = 2M
read_rnd_buffer_size            = 8M
myisam_sort_buffer_size         = 64M
max_allowed_packet              = 32M
max_heap_table_size             = 64M
tmp_table_size                  = 64M
table_cache                     = 1024
query_cache_type                = 1
query_cache_size                = 128M
query_cache_limit               = 16M
query_cache_min_res_unit        = 512
thread_concurrency              = 16
thread_cache_size               = 16
max_connections                 = 1000
ft_max_word_len                 = 20
ft_min_word_len                 = 3
local_infile                    = 0
log_warnings                    = 2
long_query_time                 = 3
log_slow_queries                = /var/log/mysql/slow-queries.log
log_queries_not_using_indexes
#log_slave_updates
log_long_format
skip_bdb
#skip_innodb
innodb_thread_concurrency       = 8
innodb_buffer_pool_size         = 512M
innodb_additional_mem_pool_size = 16M
innodb_data_home_dir            = /var/lib/mysql
innodb_log_arch_dir             = /var/lib/mysql
innodb_log_group_home_dir       = /var/lib/mysql
innodb_data_file_path           = ibdata1:2000M;ibdata2:10M:autoextend
innodb_flush_method             = O_DIRECT
innodb_log_file_size            = 100M
innodb_log_buffer_size          = 8M
innodb_log_files_in_group       = 2
innodb_flush_log_at_trx_commit  = 2
innodb_max_dirty_pages_pct      = 90
innodb_lock_wait_timeout        = 120
innodb_file_per_table

[mysqlhotcopy]
interactive_timeout

#
# * IMPORTANT: Additional settings that can override those from this file!
#
!includedir /etc/mysql/conf.d/


Desweiteren fehlen Dir einige Indexe und die Queries müssen ebenfalls überarbeitet werden.
PayPal.Me/JoeUserFreeBSD Remote Installation
Wings for LifeWings for Life World Run

„If there’s more than one possible outcome of a job or task, and one
of those outcomes will result in disaster or an undesirable consequence,
then somebody will do it that way.“ -- Edward Aloysius Murphy Jr.
Top

sintec
Posts: 54
Joined: 2006-10-10 22:34

Re: Welche Konfiguration ist korrekt?

Post by sintec »

So die Slow-Queries habe ich gestern Abend noch aktiviert. Verstehe ich richtig das jede Abfrage die in der Log steht überarbeitet werden muss?

Beispiel:

Code: Select all

# Time: 080529  6:26:42
# User@Host: xlspread[xlspread] @ localhost []
# Query_time: 0  Lock_time: 0  Rows_sent: 0  Rows_examined: 0
UPDATE iframe SET ccount = ccount +1;
# User@Host: xlspread[xlspread] @ localhost []
# Query_time: 0  Lock_time: 0  Rows_sent: 0  Rows_examined: 0
UPDATE iframe SET ccount = 0;
# User@Host: xlspread[xlspread] @ localhost []
# Query_time: 0  Lock_time: 0  Rows_sent: 1  Rows_examined: 120456


EDIT:

Was mir auch wirklich sehr merkwürdig vorkommt ist dieser Eintrag hier:

Code: Select all

MEMORY USAGE
Max Memory Ever Allocated : 1 G
Configured Max Per-thread Buffers : 14 G
Configured Max Global Buffers : 1 G
Configured Max Memory Limit : 16 G
Physical Memory : 3.84 G

Max memory limit exceeds 90% of physical memory


Hoffe auf kurzfristige Antwort.

Vielen Dank.

MfG,
Sintec
Top

User avatar
isotopp
RSAC
Posts: 482
Joined: 2003-08-21 10:21
Location: Berlin

Re: Welche Konfiguration ist korrekt?

Post by isotopp »

Sintec wrote:So die Slow-Queries habe ich gestern Abend noch aktiviert. Verstehe ich richtig das jede Abfrage die in der Log steht überarbeitet werden muss?


Du kannst das vorher mit "mysqldumpslow" ein wenig ordnen lassen.
Top

sintec
Posts: 54
Joined: 2006-10-10 22:34

Re: Welche Konfiguration ist korrekt?

Post by sintec »

Danke für den Hinweis. Wie man unten erkennen kannt steht dort Time=0.00s (0s) bedeutet dies die Abfragedauer des Queries?

Code: Select all

Count: 7  Time=0.00s (0s)  Lock=0.00s (0s)  Rows=2.6 (18), xlspread[xlspread]@localhost
  SELECT `group_id` FROM `user_group` WHERE `user_id`='S'

Count: 2  Time=0.00s (0s)  Lock=0.00s (0s)  Rows=1.0 (2), xlspread[xlspread]@localhost
  SELECT id FROM users WHERE login = 'S'


Danke für eure bisherigen Antworten.

MfG,
Sintec
Top

sintec
Posts: 54
Joined: 2006-10-10 22:34

Re: Welche Konfiguration ist korrekt?

Post by sintec »

Hallo,

leider muss ich feststellen das seit der neuen Konfiguration einige php-scripts an Ihren Aufgaben scheitern. Das merkwürdige ist, dass wenn ich das Script mehrfach versuche auszuführen, dass es dann irgendwann klappt und er eine Verbindung zur Datenbank aufbauen kann.

Sofern das Script abbricht erscheint folgende Fehlermeldung:

Code: Select all

Warning: mysql_connect(): Lost connection to MySQL server at 'reading authorization packet', system error: 0 in /home/uploadengine/last                       .php on line 3

Warning: mysql_select_db(): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) in /home/uploadengine/                       last.php on line 4

Warning: mysql_select_db(): A link to the server could not be established in /home/uploadengine/last.php on line 4

Warning: mysql_query(): Can't connect to local MySQL server through socket '/var/run/mysqld/mysqld.sock' (2) in /home/uploadengine/last                       .php on line 8


Ich hoffe Ihr habt eine Idee wie ich diesen Fehler beheben kann.

Danke.

MfG,
Sintec
Top

User avatar
daemotron
Administrator
Administrator
Posts: 2800
Joined: 2004-01-21 17:44

Re: Welche Konfiguration ist korrekt?

Post by daemotron »

Ins error log des mysqld schauen und herausfinden, warum der Server die Verbindung zurückgewiesen hat.
Top

braindead
RSAC
Posts: 257
Joined: 2002-10-22 09:49
Location: vorm Rechner

Re: Welche Konfiguration ist korrekt?

Post by braindead »

Sintec wrote:Danke für den Hinweis. Wie man unten erkennen kannt steht dort Time=0.00s (0s) bedeutet dies die Abfragedauer des Queries?

Code: Select all

Count: 7  Time=0.00s (0s)  Lock=0.00s (0s)  Rows=2.6 (18), xlspread[xlspread]@localhost
  SELECT `group_id` FROM `user_group` WHERE `user_id`='S'

Count: 2  Time=0.00s (0s)  Lock=0.00s (0s)  Rows=1.0 (2), xlspread[xlspread]@localhost
  SELECT id FROM users WHERE login = 'S'


geloggt werden auch alle queries die keinen Index benutzen (log_queries_not_using_indexes). Es ist also zu prüfen ob ein Index auf user_id in der user_group und auf login in der users gesetzt werden muss / sollte.
Top