Hello,

I'm having issues where once every 24-36 hours a replication slave
locks up and I have to kill -9 the process and restart it. I'm using
mysql 5.1.26 and centos 5 (kernel 2.6.18-92.el5) but it's been
occurring since I simultaneously upgraded to 5x and started using the
slave in production (instead of as a server to just run mysqldump on).
I've tried the last 3 versions of mysql, upgraded to the latest
centos, and I'm starting to wonder if it could be hardware related.
Either way, here is the .err info from the most recent crash, I'd
appreciate any help -- hopefully something in here jumps out at
someone and I'm just doing something stupid.

Status information:

Current dir: /usr/local/mysql/var/
Running threads: 5 Stack size: 262144
Current locks:
lock: 0x20436290:

lock: 0x1f1acf00:

lock: 0x1fed76d0:

lock: 0x2aaaec214188:

lock: 0x2aaaec212c58:

lock: 0x2aaaec208438:

lock: 0x1ec4b168:

lock: 0x1e52c898:

lock: 0x1e11c0d8:

lock: 0x1fc4dcb8:

lock: 0x1e162b98:

lock: 0x1e161db8:

lock: 0x1f700aa0:

lock: 0x1ec00b20:


lock: 0x1fc25dc0:

lock: 0x1f30c7d0:

lock: 0x1fac89c8:

lock: 0x203f75f8:

lock: 0x1e4a0d98:

lock: 0x1eee3908:

lock: 0x1eec8278:

lock: 0x1f324f18:

lock: 0x1f5e38a8:

lock: 0x1fac1028:

lock: 0x2aaae407e288:

lock: 0x2aaaec036480:

lock: 0x2aaaec05e968:

lock: 0x1e116bf0:

lock: 0x2aaaec05be88:

lock: 0x1ed4b5c8:

lock: 0x1f7938a8:

lock: 0x1e36be48:

lock: 0x1fc691b0:

lock: 0x1fc983b0:

lock: 0x1e72db60:

lock: 0x1f13aad8:

lock: 0x2aaaec02ca08:

lock: 0x1ee6bed8:

lock: 0x1eab1eb8:

lock: 0x1fa8a4c8:

lock: 0x1e832c58:

lock: 0x1ef0b7d8:

lock: 0x2aaae80689d8:

lock: 0x1eec3a28:

lock: 0x2aaae413bd78:

lock: 0x2aaae41b0078:

lock: 0x2aaae412c1c8:

lock: 0x1fa88f78:

lock: 0x1e43aea8:

lock: 0x1e71de68:

lock: 0x1fa3ff78:

lock: 0x1f391730:

lock: 0x1f391620:

lock: 0x1e462890:

lock: 0x1f342610:

lock: 0x1eec6278:

lock: 0x1eec6e98:

lock: 0x1e7085f8:

lock: 0x1fc696c8:

lock: 0x1f98c338:

lock: 0x1ec11e00:

lock: 0x1e442760:

lock: 0x1e79be90:

lock: 0x1ef71e28:

lock: 0x1ef2dc68:

lock: 0x2aaae851f448:

lock: 0x2aaae837de68:

lock: 0x1f33f728:

lock: 0x2aaae41add68:

lock: 0x1e34caf8:

lock: 0x2aaae83d1868:

lock: 0x1e71d510:

lock: 0x1f026600:

lock: 0x1e7a7318:

lock: 0x1ef1e740:

lock: 0x1ed13180:

lock: 0x1eca5860:

lock: 0x1e72ca30:

lock: 0x1e7c9b68:

lock: 0x1e7b4bc8:

lock: 0x1e7b1b98:

lock: 0x1ea7d958:

lock: 0x1e4d6fa8:

lock: 0x1e79dc28:

lock: 0x1eac0798:

lock: 0x1e5115d8:

lock: 0x1eac6958:

lock: 0x1e514608:

lock: 0x1eab1270:

lock: 0x2aaae402ae48: read
read : 0x1ee6f9d0 (82781:1);

lock: 0x2aaae40276f8: read
read : 0x1e47d920 (82781:1);

lock: 0x2aaae4017ed8:

lock: 0x1eab0c08:

lock: 0x1eaf0f68:

lock: 0x1e523c48:

lock: 0x1eab2a88:

lock: 0x1ea90028:

lock: 0x1eaa85c8:


lock: 0x1ea8d318:

lock: 0x1e5267f8:


Key caches:
default
Buffer_size: 402653184
Block_size: 1024
Division_limit: 100
Age_limit: 300
blocks used: 172670
not flushed: 0
w_requests: 1619446
writes: 153057
r_requests: 645726100
reads: 172881


handler status:
read_key: 244157667
read_next: 187779363
read_rnd 8229903
read_first: 969
write: 11072520
delete 8139
update: 15260322

Table status: Opened tables: 1501
Open tables: 512
Open files: 522
Open streams: 0

Alarm status:
Active alarms: 5
Max used alarms: 35
Next alarm time: 60

Thread database.table_name Locked/Waiting Lock_type

82781 esea.messages_users Locked - read Low priority read lock
82781 esea.support_tickets Locked - read Low priority read lock




Begin safemalloc memory dump:

End safemalloc memory dump.

Memory status:
Non-mmapped space allocated from system: 87920832
Number of free chunks: 779
Number of fastbin blocks: 0
Number of mmapped regions: 15
Space in mmapped regions: 897253376
Maximum total allocated space: 0
Space available in freed fastbin blocks: 0
Total allocated space: 50178912
Total free space: 37741920
Top-most, releasable space: 30251296
Estimated memory (with thread stack): 986222784



Events status:
LLA = Last Locked At LUA = Last Unlocked At
WOC = Waiting On Condition DL = Data Locked

Event scheduler status:
State : INITIALIZED
Thread id : 0
LLA : n/a:0
LUA : n/a:0
WOC : NO
Workers : 0
Executed : 0
Data locked: NO

Event queue status:
Element count : 0
Data locked : NO
Attempting lock : NO
LLA : init_queue:132
LUA : init_queue:142
WOC : NO
Next activation : never