LinuxForum.Fans
Тема

внезапное падение debian

Автор: Onibi 3 сообщений 3291 просмотров
17.03.2010 15:55 #15963

Есть довольно мощный сервер на платформе Supermicro H8QM3-2 c 4хAMD Opteron 8350 и 64Гигами оперативки на борту. Смысл его жизнь в работе c довольно тяжеловесной базой mysql.
Но насладится работой сервера не дают внезапные произвольные(может быть не падать месяцами, а потом 3 падения за неделю) зависания сервера.
В /var/log/messages на момент падения можно обнаружить сообщения вида:

text
Mar 17 14:04:27 replica kernel: CPU 12:
Mar 17 14:04:27 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:27 replica kernel: Pid: 10621, comm: mysqld Not tainted 2.6.24 #4
Mar 17 14:04:27 replica kernel: RIP: 0010:[<ffffffff8046a0ec>]  [<ffffffff8046a0ec>] _spin_lock_irqsave+0x12/0x24
Mar 17 14:04:27 replica kernel: RSP: 0018:ffff81010043ba60  EFLAGS: 00000286
Mar 17 14:04:27 replica kernel: RAX: 0000000000000292 RBX: ffff81010043ba98 RCX: 0000000000000000
Mar 17 14:04:27 replica kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff810000040bbf
Mar 17 14:04:27 replica kernel: RBP: 0000000000001000 R08: 0000000000000000 R09: 0000000000000618
Mar 17 14:04:27 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Mar 17 14:04:27 replica kernel: R13: 0000000000000001 R14: 0000000000000000 R15: ffff81032ae9b580
Mar 17 14:04:27 replica kernel: FS:  00002aac2cd0e960(0000) GS:ffff810c284f5cc0(0000) knlGS:0000000000000000
Mar 17 14:04:27 replica kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 17 14:04:27 replica kernel: CR2: 00002aab47f26000 CR3: 000000062affc000 CR4: 00000000000006e0
Mar 17 14:04:27 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:27 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:27 replica kernel: 
Mar 17 14:04:27 replica kernel: Call Trace:
Mar 17 14:04:27 replica kernel: [<ffffffff802270f0>] __wake_up+0x22/0x4f
Mar 17 14:04:27 replica kernel: [<ffffffff8025d675>] __alloc_pages+0x99/0x2fb
Mar 17 14:04:27 replica kernel: [<ffffffff80258803>] __grab_cache_page+0x33/0x6f
Mar 17 14:04:27 replica kernel: [<ffffffff802bfb42>] ext3_write_begin+0x6b/0x1ab
Mar 17 14:04:27 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:27 replica kernel: [<ffffffff80259466>] generic_file_buffered_write+0x150/0x64d
Mar 17 14:04:27 replica kernel: [<ffffffff80233393>] current_fs_time+0x1e/0x24
Mar 17 14:04:27 replica kernel: [<ffffffff80259ca1>] __generic_file_aio_write_nolock+0x33e/0x3a8
Mar 17 14:04:27 replica kernel: [<ffffffff802406bf>] bit_waitqueue+0x1c/0x90
Mar 17 14:04:27 replica kernel: [<ffffffff802cbb6d>] do_get_write_access+0x377/0x3ba
Mar 17 14:04:27 replica kernel: [<ffffffff80259d6c>] generic_file_aio_write+0x61/0xc1
Mar 17 14:04:27 replica kernel: [<ffffffff802bbfbe>] ext3_file_write+0x16/0x94
Mar 17 14:04:27 replica kernel: [<ffffffff8027c218>] do_sync_write+0xc9/0x10c
Mar 17 14:04:27 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:27 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:27 replica kernel: [<ffffffff8027c9bd>] vfs_write+0xc6/0x14f
Mar 17 14:04:27 replica kernel: [<ffffffff8027d59a>] fget_light+0x64/0x7e
Mar 17 14:04:27 replica kernel: [<ffffffff8027cf13>] sys_write+0x45/0x6e
Mar 17 14:04:27 replica kernel: [<ffffffff8020bdce>] system_call+0x7e/0x83
Mar 17 14:04:27 replica kernel: 
Mar 17 14:04:27 replica kernel: CPU 2:
Mar 17 14:04:27 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:27 replica kernel: Pid: 486, comm: kswapd0 Not tainted 2.6.24 #4
Mar 17 14:04:28 replica kernel: RIP: 0010:[<ffffffff8046a0ef>]  [<ffffffff8046a0ef>] _spin_lock_irqsave+0x15/0x24
Mar 17 14:04:28 replica kernel: RSP: 0018:ffff810329c63e18  EFLAGS: 00000286
Mar 17 14:04:28 replica kernel: RAX: 0000000000000246 RBX: ffff810000040bbf RCX: 0000000000000003
Mar 17 14:04:28 replica kernel: RDX: 0000000000000001 RSI: ffff810329c63ea0 RDI: ffff810000040bbf
Mar 17 14:04:28 replica kernel: RBP: ffff810335044ed0 R08: 0000000000000000 R09: 0000000000000b3b
Mar 17 14:04:28 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff81033525d9a0
Mar 17 14:04:28 replica kernel: R13: ffffffff8025e54c R14: ffff81033520a260 R15: ffff810335269b38
Mar 17 14:04:28 replica kernel: FS:  00002aac1d9b8960(0000) GS:ffff81032ac98c40(0000) knlGS:0000000000000000
Mar 17 14:04:28 replica kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Mar 17 14:04:28 replica kernel: CR2: 00002aab48529000 CR3: 0000000000201000 CR4: 00000000000006e0
Mar 17 14:04:28 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:28 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:28 replica kernel: 
Mar 17 14:04:28 replica kernel: Call Trace:
Mar 17 14:04:28 replica kernel: [<ffffffff802408a3>] prepare_to_wait+0x15/0x5f
Mar 17 14:04:28 replica kernel: [<ffffffff80261d4d>] kswapd+0xb4/0x435
Mar 17 14:04:28 replica kernel: [<ffffffff80468d22>] thread_return+0x3d/0xab
Mar 17 14:04:28 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:28 replica kernel: [<ffffffff80261c99>] kswapd+0x0/0x435
Mar 17 14:04:28 replica kernel: [<ffffffff80240662>] kthread+0x47/0x75
Mar 17 14:04:28 replica kernel: [<ffffffff8020cbe8>] child_rip+0xa/0x12
Mar 17 14:04:28 replica kernel: [<ffffffff8021933e>] physflat_send_IPI_mask+0x0/0x8b
Mar 17 14:04:28 replica kernel: [<ffffffff8024061b>] kthread+0x0/0x75
Mar 17 14:04:28 replica kernel: [<ffffffff8020cbde>] child_rip+0x0/0x12
Mar 17 14:04:28 replica kernel: 
Mar 17 14:04:28 replica kernel: CPU 3:
Mar 17 14:04:28 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:28 replica kernel: Pid: 2617, comm: mysqld Not tainted 2.6.24 #4
Mar 17 14:04:28 replica kernel: RIP: 0010:[<ffffffff8046a0ec>]  [<ffffffff8046a0ec>] _spin_lock_irqsave+0x12/0x24
Mar 17 14:04:28 replica kernel: RSP: 0018:ffff8103922afa60  EFLAGS: 00000286
Mar 17 14:04:28 replica kernel: RAX: 0000000000000292 RBX: ffff8103922afa98 RCX: 0000000000000000
Mar 17 14:04:28 replica kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff810000040bbf
Mar 17 14:04:28 replica kernel: RBP: 0000000000001000 R08: 0000000000000000 R09: 0000000000000618
Mar 17 14:04:28 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Mar 17 14:04:28 replica kernel: R13: 0000000000000001 R14: 000000010000020e R15: 000000002d3dd400
Mar 17 14:04:28 replica kernel: FS:  00002aabb6c71960(0000) GS:ffff81032ac982c0(0000) knlGS:0000000000000000
Mar 17 14:04:28 replica kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 17 14:04:28 replica kernel: CR2: 00002aab47f26000 CR3: 000000062affc000 CR4: 00000000000006e0
Mar 17 14:04:28 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:28 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:28 replica kernel: 
Mar 17 14:04:28 replica kernel: Call Trace:
Mar 17 14:04:28 replica kernel: [<ffffffff802270f0>] __wake_up+0x22/0x4f
Mar 17 14:04:28 replica kernel: [<ffffffff8025d675>] __alloc_pages+0x99/0x2fb
Mar 17 14:04:28 replica kernel: [<ffffffff80258803>] __grab_cache_page+0x33/0x6f
Mar 17 14:04:28 replica kernel: [<ffffffff802bfb42>] ext3_write_begin+0x6b/0x1ab
Mar 17 14:04:28 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:28 replica kernel: [<ffffffff80259466>] generic_file_buffered_write+0x150/0x64d
Mar 17 14:04:28 replica kernel: [<ffffffff80233393>] current_fs_time+0x1e/0x24
Mar 17 14:04:28 replica kernel: [<ffffffff80259ca1>] __generic_file_aio_write_nolock+0x33e/0x3a8
Mar 17 14:04:28 replica kernel: [<ffffffff80259d6c>] generic_file_aio_write+0x61/0xc1
Mar 17 14:04:28 replica kernel: [<ffffffff802bbfbe>] ext3_file_write+0x16/0x94
Mar 17 14:04:28 replica kernel: [<ffffffff8027c218>] do_sync_write+0xc9/0x10c
Mar 17 14:04:28 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:28 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:28 replica kernel: [<ffffffff8027c9bd>] vfs_write+0xc6/0x14f
Mar 17 14:04:28 replica kernel: [<ffffffff8027cf13>] sys_write+0x45/0x6e
Mar 17 14:04:28 replica kernel: [<ffffffff8020bdce>] system_call+0x7e/0x83
Mar 17 14:04:28 replica kernel: 
Mar 17 14:04:39 replica kernel: CPU 12:
Mar 17 14:04:39 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:39 replica kernel: Pid: 10621, comm: mysqld Not tainted 2.6.24 #4
Mar 17 14:04:39 replica kernel: RIP: 0010:[<ffffffff8046a0ec>]  [<ffffffff8046a0ec>] _spin_lock_irqsave+0x12/0x24
Mar 17 14:04:39 replica kernel: RSP: 0018:ffff81010043ba60  EFLAGS: 00000286
Mar 17 14:04:39 replica kernel: RAX: 0000000000000292 RBX: ffff81010043ba98 RCX: 0000000000000000
Mar 17 14:04:39 replica kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff810000040bbf
Mar 17 14:04:39 replica kernel: RBP: 0000000000001000 R08: 0000000000000000 R09: 0000000000000618
Mar 17 14:04:39 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Mar 17 14:04:39 replica kernel: R13: 0000000000000001 R14: 0000000000000000 R15: ffff81032ae9b580
Mar 17 14:04:39 replica kernel: FS:  00002aac2cd0e960(0000) GS:ffff810c284f5cc0(0000) knlGS:0000000000000000
Mar 17 14:04:39 replica kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 17 14:04:39 replica kernel: CR2: 00002aab47f26000 CR3: 000000062affc000 CR4: 00000000000006e0
Mar 17 14:04:39 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:39 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:39 replica kernel: 
Mar 17 14:04:39 replica kernel: Call Trace:
Mar 17 14:04:39 replica kernel: [<ffffffff802270f0>] __wake_up+0x22/0x4f
Mar 17 14:04:39 replica kernel: [<ffffffff8025d675>] __alloc_pages+0x99/0x2fb
Mar 17 14:04:39 replica kernel: [<ffffffff80258803>] __grab_cache_page+0x33/0x6f
Mar 17 14:04:39 replica kernel: [<ffffffff802bfb42>] ext3_write_begin+0x6b/0x1ab
Mar 17 14:04:39 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:39 replica kernel: [<ffffffff80259466>] generic_file_buffered_write+0x150/0x64d
Mar 17 14:04:39 replica kernel: [<ffffffff80233393>] current_fs_time+0x1e/0x24
Mar 17 14:04:39 replica kernel: [<ffffffff80259ca1>] __generic_file_aio_write_nolock+0x33e/0x3a8
Mar 17 14:04:39 replica kernel: [<ffffffff802406bf>] bit_waitqueue+0x1c/0x90
Mar 17 14:04:39 replica kernel: [<ffffffff802cbb6d>] do_get_write_access+0x377/0x3ba
Mar 17 14:04:39 replica kernel: [<ffffffff80259d6c>] generic_file_aio_write+0x61/0xc1
Mar 17 14:04:39 replica kernel: [<ffffffff802bbfbe>] ext3_file_write+0x16/0x94
Mar 17 14:04:39 replica kernel: [<ffffffff8027c218>] do_sync_write+0xc9/0x10c
Mar 17 14:04:39 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:39 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:39 replica kernel: [<ffffffff8027c9bd>] vfs_write+0xc6/0x14f
Mar 17 14:04:39 replica kernel: [<ffffffff8027d59a>] fget_light+0x64/0x7e
Mar 17 14:04:39 replica kernel: [<ffffffff8027cf13>] sys_write+0x45/0x6e
Mar 17 14:04:39 replica kernel: [<ffffffff8020bdce>] system_call+0x7e/0x83
Mar 17 14:04:39 replica kernel: 
Mar 17 14:04:39 replica kernel: CPU 2:
Mar 17 14:04:39 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:39 replica kernel: Pid: 486, comm: kswapd0 Not tainted 2.6.24 #4
Mar 17 14:04:39 replica kernel: RIP: 0010:[<ffffffff8046a0ef>]  [<ffffffff8046a0ef>] _spin_lock_irqsave+0x15/0x24
Mar 17 14:04:39 replica kernel: RSP: 0018:ffff810329c63e18  EFLAGS: 00000286
Mar 17 14:04:39 replica kernel: RAX: 0000000000000246 RBX: ffff810000040bbf RCX: 0000000000000003
Mar 17 14:04:39 replica kernel: RDX: 0000000000000001 RSI: ffff810329c63ea0 RDI: ffff810000040bbf
Mar 17 14:04:39 replica kernel: RBP: ffff810335044ed0 R08: 0000000000000000 R09: 0000000000000b3b
Mar 17 14:04:39 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff81033525d9a0
Mar 17 14:04:39 replica kernel: R13: ffffffff8025e54c R14: ffff81033520a260 R15: ffff810335269b38
Mar 17 14:04:39 replica kernel: FS:  00002aac1d9b8960(0000) GS:ffff81032ac98c40(0000) knlGS:0000000000000000
Mar 17 14:04:39 replica kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Mar 17 14:04:39 replica kernel: CR2: 00002aab48529000 CR3: 0000000000201000 CR4: 00000000000006e0
Mar 17 14:04:39 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:39 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:39 replica kernel: 
Mar 17 14:04:39 replica kernel: Call Trace:
Mar 17 14:04:39 replica kernel: [<ffffffff802408a3>] prepare_to_wait+0x15/0x5f
Mar 17 14:04:39 replica kernel: [<ffffffff80261d4d>] kswapd+0xb4/0x435
Mar 17 14:04:39 replica kernel: [<ffffffff80468d22>] thread_return+0x3d/0xab
Mar 17 14:04:39 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:39 replica kernel: [<ffffffff80261c99>] kswapd+0x0/0x435
Mar 17 14:04:39 replica kernel: [<ffffffff80240662>] kthread+0x47/0x75
Mar 17 14:04:39 replica kernel: [<ffffffff8020cbe8>] child_rip+0xa/0x12
Mar 17 14:04:39 replica kernel: [<ffffffff8021933e>] physflat_send_IPI_mask+0x0/0x8b
Mar 17 14:04:39 replica kernel: [<ffffffff8024061b>] kthread+0x0/0x75
Mar 17 14:04:39 replica kernel: [<ffffffff8020cbde>] child_rip+0x0/0x12
Mar 17 14:04:39 replica kernel: 
Mar 17 14:04:39 replica kernel: CPU 3:
Mar 17 14:04:39 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:39 replica kernel: Pid: 2617, comm: mysqld Not tainted 2.6.24 #4
Mar 17 14:04:39 replica kernel: RIP: 0010:[<ffffffff8046a0ec>]  [<ffffffff8046a0ec>] _spin_lock_irqsave+0x12/0x24
Mar 17 14:04:39 replica kernel: RSP: 0018:ffff8103922afa60  EFLAGS: 00000286
Mar 17 14:04:39 replica kernel: RAX: 0000000000000292 RBX: ffff8103922afa98 RCX: 0000000000000000
Mar 17 14:04:39 replica kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff810000040bbf
Mar 17 14:04:39 replica kernel: RBP: 0000000000001000 R08: 0000000000000000 R09: 0000000000000618
Mar 17 14:04:39 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Mar 17 14:04:39 replica kernel: R13: 0000000000000001 R14: 000000010000020e R15: 000000002d3dd400
Mar 17 14:04:39 replica kernel: FS:  00002aabb6c71960(0000) GS:ffff81032ac982c0(0000) knlGS:0000000000000000
Mar 17 14:04:39 replica kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 17 14:04:39 replica kernel: CR2: 00002aab47f26000 CR3: 000000062affc000 CR4: 00000000000006e0
Mar 17 14:04:39 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:39 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:39 replica kernel: 
Mar 17 14:04:39 replica kernel: Call Trace:
Mar 17 14:04:39 replica kernel: [<ffffffff802270f0>] __wake_up+0x22/0x4f
Mar 17 14:04:39 replica kernel: [<ffffffff8025d675>] __alloc_pages+0x99/0x2fb
Mar 17 14:04:39 replica kernel: [<ffffffff80258803>] __grab_cache_page+0x33/0x6f
Mar 17 14:04:39 replica kernel: [<ffffffff802bfb42>] ext3_write_begin+0x6b/0x1ab
Mar 17 14:04:39 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:39 replica kernel: [<ffffffff80259466>] generic_file_buffered_write+0x150/0x64d
Mar 17 14:04:39 replica kernel: [<ffffffff80233393>] current_fs_time+0x1e/0x24
Mar 17 14:04:39 replica kernel: [<ffffffff80259ca1>] __generic_file_aio_write_nolock+0x33e/0x3a8
Mar 17 14:04:39 replica kernel: [<ffffffff80259d6c>] generic_file_aio_write+0x61/0xc1
Mar 17 14:04:39 replica kernel: [<ffffffff802bbfbe>] ext3_file_write+0x16/0x94
Mar 17 14:04:39 replica kernel: [<ffffffff8027c218>] do_sync_write+0xc9/0x10c
Mar 17 14:04:39 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:39 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:39 replica kernel: [<ffffffff8027c9bd>] vfs_write+0xc6/0x14f
Mar 17 14:04:39 replica kernel: [<ffffffff8027cf13>] sys_write+0x45/0x6e
Mar 17 14:04:39 replica kernel: [<ffffffff8020bdce>] system_call+0x7e/0x83
Mar 17 14:04:39 replica kernel: 
Mar 17 14:04:51 replica kernel: CPU 12:
Mar 17 14:04:51 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:51 replica kernel: Pid: 10621, comm: mysqld Not tainted 2.6.24 #4
Mar 17 14:04:51 replica kernel: RIP: 0010:[<ffffffff8046a0ef>]  [<ffffffff8046a0ef>] _spin_lock_irqsave+0x15/0x24
Mar 17 14:04:51 replica kernel: RSP: 0018:ffff81010043ba60  EFLAGS: 00000286
Mar 17 14:04:51 replica kernel: RAX: 0000000000000292 RBX: ffff81010043ba98 RCX: 0000000000000000
Mar 17 14:04:51 replica kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff810000040bbf
Mar 17 14:04:51 replica kernel: RBP: 0000000000001000 R08: 0000000000000000 R09: 0000000000000618
Mar 17 14:04:51 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Mar 17 14:04:51 replica kernel: R13: 0000000000000001 R14: 0000000000000000 R15: ffff81032ae9b580
Mar 17 14:04:51 replica kernel: FS:  00002aac2cd0e960(0000) GS:ffff810c284f5cc0(0000) knlGS:0000000000000000
Mar 17 14:04:51 replica kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 17 14:04:51 replica kernel: CR2: 00002aab47f26000 CR3: 000000062affc000 CR4: 00000000000006e0
Mar 17 14:04:51 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:51 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:51 replica kernel: 
Mar 17 14:04:51 replica kernel: Call Trace:
Mar 17 14:04:51 replica kernel: [<ffffffff802270f0>] __wake_up+0x22/0x4f
Mar 17 14:04:51 replica kernel: [<ffffffff8025d675>] __alloc_pages+0x99/0x2fb
Mar 17 14:04:51 replica kernel: [<ffffffff80258803>] __grab_cache_page+0x33/0x6f
Mar 17 14:04:51 replica kernel: [<ffffffff802bfb42>] ext3_write_begin+0x6b/0x1ab
Mar 17 14:04:51 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:51 replica kernel: [<ffffffff80259466>] generic_file_buffered_write+0x150/0x64d
Mar 17 14:04:51 replica kernel: [<ffffffff80233393>] current_fs_time+0x1e/0x24
Mar 17 14:04:51 replica kernel: [<ffffffff80259ca1>] __generic_file_aio_write_nolock+0x33e/0x3a8
Mar 17 14:04:51 replica kernel: [<ffffffff802406bf>] bit_waitqueue+0x1c/0x90
Mar 17 14:04:51 replica kernel: [<ffffffff802cbb6d>] do_get_write_access+0x377/0x3ba
Mar 17 14:04:51 replica kernel: [<ffffffff80259d6c>] generic_file_aio_write+0x61/0xc1
Mar 17 14:04:51 replica kernel: [<ffffffff802bbfbe>] ext3_file_write+0x16/0x94
Mar 17 14:04:51 replica kernel: [<ffffffff8027c218>] do_sync_write+0xc9/0x10c
Mar 17 14:04:51 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:51 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:51 replica kernel: [<ffffffff8027c9bd>] vfs_write+0xc6/0x14f
Mar 17 14:04:51 replica kernel: [<ffffffff8027d59a>] fget_light+0x64/0x7e
Mar 17 14:04:51 replica kernel: [<ffffffff8027cf13>] sys_write+0x45/0x6e
Mar 17 14:04:51 replica kernel: [<ffffffff8020bdce>] system_call+0x7e/0x83
Mar 17 14:04:51 replica kernel: 
Mar 17 14:04:51 replica kernel: CPU 2:
Mar 17 14:04:51 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:51 replica kernel: Pid: 486, comm: kswapd0 Not tainted 2.6.24 #4
Mar 17 14:04:51 replica kernel: RIP: 0010:[<ffffffff8046a0ef>]  [<ffffffff8046a0ef>] _spin_lock_irqsave+0x15/0x24
Mar 17 14:04:51 replica kernel: RSP: 0018:ffff810329c63e18  EFLAGS: 00000286
Mar 17 14:04:51 replica kernel: RAX: 0000000000000246 RBX: ffff810000040bbf RCX: 0000000000000003
Mar 17 14:04:51 replica kernel: RDX: 0000000000000001 RSI: ffff810329c63ea0 RDI: ffff810000040bbf
Mar 17 14:04:51 replica kernel: RBP: ffff810335044ed0 R08: 0000000000000000 R09: 0000000000000b3b
Mar 17 14:04:51 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: ffff81033525d9a0
Mar 17 14:04:51 replica kernel: R13: ffffffff8025e54c R14: ffff81033520a260 R15: ffff810335269b38
Mar 17 14:04:51 replica kernel: FS:  00002aac1d9b8960(0000) GS:ffff81032ac98c40(0000) knlGS:0000000000000000
Mar 17 14:04:51 replica kernel: CS:  0010 DS: 0018 ES: 0018 CR0: 000000008005003b
Mar 17 14:04:51 replica kernel: CR2: 00002aab48529000 CR3: 0000000000201000 CR4: 00000000000006e0
Mar 17 14:04:51 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:51 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:51 replica kernel: 
Mar 17 14:04:51 replica kernel: Call Trace:
Mar 17 14:04:51 replica kernel: [<ffffffff802408a3>] prepare_to_wait+0x15/0x5f
Mar 17 14:04:51 replica kernel: [<ffffffff80261d4d>] kswapd+0xb4/0x435
Mar 17 14:04:51 replica kernel: [<ffffffff80468d22>] thread_return+0x3d/0xab
Mar 17 14:04:51 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:51 replica kernel: [<ffffffff80261c99>] kswapd+0x0/0x435
Mar 17 14:04:51 replica kernel: [<ffffffff80240662>] kthread+0x47/0x75
Mar 17 14:04:51 replica kernel: [<ffffffff8020cbe8>] child_rip+0xa/0x12
Mar 17 14:04:51 replica kernel: [<ffffffff8021933e>] physflat_send_IPI_mask+0x0/0x8b
Mar 17 14:04:51 replica kernel: [<ffffffff8024061b>] kthread+0x0/0x75
Mar 17 14:04:51 replica kernel: [<ffffffff8020cbde>] child_rip+0x0/0x12
Mar 17 14:04:51 replica kernel: 
Mar 17 14:04:51 replica kernel: CPU 3:
Mar 17 14:04:51 replica kernel: Modules linked in: ipip tunnel4 serio_raw usbhid
Mar 17 14:04:51 replica kernel: Pid: 2617, comm: mysqld Not tainted 2.6.24 #4
Mar 17 14:04:51 replica kernel: RIP: 0010:[<ffffffff8046a0ea>]  [<ffffffff8046a0ea>] _spin_lock_irqsave+0x10/0x24
Mar 17 14:04:51 replica kernel: RSP: 0018:ffff8103922afa60  EFLAGS: 00000286
Mar 17 14:04:51 replica kernel: RAX: 0000000000000292 RBX: ffff8103922afa98 RCX: 0000000000000000
Mar 17 14:04:51 replica kernel: RDX: 0000000000000001 RSI: 0000000000000001 RDI: ffff810000040bbf
Mar 17 14:04:51 replica kernel: RBP: 0000000000001000 R08: 0000000000000000 R09: 0000000000000618
Mar 17 14:04:51 replica kernel: R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
Mar 17 14:04:51 replica kernel: R13: 0000000000000001 R14: 000000010000020e R15: 000000002d3dd400
Mar 17 14:04:51 replica kernel: FS:  00002aabb6c71960(0000) GS:ffff81032ac982c0(0000) knlGS:0000000000000000
Mar 17 14:04:51 replica kernel: CS:  0010 DS: 0000 ES: 0000 CR0: 000000008005003b
Mar 17 14:04:51 replica kernel: CR2: 00002aab47f26000 CR3: 000000062affc000 CR4: 00000000000006e0
Mar 17 14:04:51 replica kernel: DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000
Mar 17 14:04:52 replica kernel: DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400
Mar 17 14:04:52 replica kernel: 
Mar 17 14:04:52 replica kernel: Call Trace:
Mar 17 14:04:52 replica kernel: [<ffffffff802270f0>] __wake_up+0x22/0x4f
Mar 17 14:04:52 replica kernel: [<ffffffff8025d675>] __alloc_pages+0x99/0x2fb
Mar 17 14:04:52 replica kernel: [<ffffffff80258803>] __grab_cache_page+0x33/0x6f
Mar 17 14:04:52 replica kernel: [<ffffffff802bfb42>] ext3_write_begin+0x6b/0x1ab
Mar 17 14:04:52 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:52 replica kernel: [<ffffffff80259466>] generic_file_buffered_write+0x150/0x64d
Mar 17 14:04:52 replica kernel: [<ffffffff80233393>] current_fs_time+0x1e/0x24
Mar 17 14:04:52 replica kernel: [<ffffffff80259ca1>] __generic_file_aio_write_nolock+0x33e/0x3a8
Mar 17 14:04:52 replica kernel: [<ffffffff80259d6c>] generic_file_aio_write+0x61/0xc1
Mar 17 14:04:52 replica kernel: [<ffffffff802bbfbe>] ext3_file_write+0x16/0x94
Mar 17 14:04:52 replica kernel: [<ffffffff8027c218>] do_sync_write+0xc9/0x10c
Mar 17 14:04:52 replica kernel: [<ffffffff802c4e25>] __ext3_journal_stop+0x1f/0x3d
Mar 17 14:04:52 replica kernel: [<ffffffff80240782>] autoremove_wake_function+0x0/0x2e
Mar 17 14:04:52 replica kernel: [<ffffffff8027c9bd>] vfs_write+0xc6/0x14f
Mar 17 14:04:52 replica kernel: [<ffffffff8027cf13>] sys_write+0x45/0x6e
Mar 17 14:04:52 replica kernel: [<ffffffff8020bdce>] system_call+0x7e/0x83
Mar 17 14:04:52 replica kernel:

Куда копать ?

17.03.2010 16:59 #16014

Подозреваю, что проблема с записью/получением данных с винчестера. Прогоните винт SMATR тулзом.

17.03.2010 18:54 #16079

Если в SMART будут параметры с миллионными значениями, кроме Hardware ECC (характерно для Seagate), значит есть ошибки позиционирования, это говорит о ухудшении механики привода головок. Если много Reallocated Sector Count -- бэды. В обоих случаях нужно менять диск. Удачи !

Войдите или зарегистрируйтесь, чтобы ответить.