anuratra
asked on
linux server not response
sometime linux server will not response. I can't ping. Keyboard and mouse unable access when the problem occured. It may happen around 1 time a month.
Some log from /var/adm/messages
Some log from /var/adm/messages
Sep 13 09:20:52 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: Call Trace:
Sep 13 09:21:16 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 09:21:16 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 09:21:16 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 09:21:16 localhost kernel: <EOI> [<ffffffff8018321d>] acpi_processor_idle+0x1d6/0x463
Sep 13 09:21:16 localhost kernel: [<ffffffff8018316d>] acpi_processor_idle+0x126/0x463
Sep 13 09:21:16 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 13 09:21:16 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 13 09:21:16 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 13 09:21:16 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: Call Trace:
Sep 13 09:21:16 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 09:21:16 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 09:21:16 localhost kernel: [<ffffffff80092ada>] process_timeout+0x0/0x5
Sep 13 09:21:16 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 09:21:16 localhost kernel: [<ffffffff80216b2f>] neigh_periodic_timer+0x0/0x157
Sep 13 09:21:16 localhost kernel: [<ffffffff800928e1>] run_timer_softirq+0x12a/0x1b0
Sep 13 09:21:16 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 13 09:21:16 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 09:21:16 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 09:21:16 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 13 09:21:16 localhost kernel: [<ffffffff882c3c99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 13 09:21:16 localhost kernel: [<ffffffff882c7f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 13 09:21:16 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 13 09:21:16 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 13 09:21:16 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 13 09:21:16 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 13 09:21:16 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 13 09:21:16 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: Call Trace:
Sep 13 09:21:16 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 09:21:16 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 09:21:16 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 09:21:16 localhost kernel: <EOI> [<ffffffff80125318>] avtab_search_node+0x38/0x6a
Sep 13 09:21:16 localhost kernel: [<ffffffff80128b08>] context_struct_compute_av+0x166/0x2ba
Sep 13 09:21:16 localhost kernel: [<ffffffff8012971e>] security_compute_av+0xba/0xcd
Sep 13 09:21:16 localhost kernel: [<ffffffff8011b90b>] avc_has_perm_noaudit+0x136/0x36b
Sep 13 09:21:16 localhost kernel: [<ffffffff8011c6ee>] avc_has_perm+0x26/0x55
Sep 13 09:21:16 localhost kernel: [<ffffffff8008d6b4>] do_syslog+0x20/0x3ae
Sep 13 09:21:16 localhost kernel: [<ffffffff800fb837>] kmsg_read+0x3a/0x44
Sep 13 09:21:16 localhost kernel: [<ffffffff8000b270>] vfs_read+0xcb/0x171
Sep 13 09:21:16 localhost kernel: [<ffffffff800114f7>] sys_read+0x45/0x6e
Sep 13 09:21:16 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 13 09:21:16 localhost kernel:
Sep 13 09:21:16 localhost kernel: Call Trace:
Sep 13 09:21:16 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 09:21:16 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 09:21:16 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 09:21:16 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 09:21:16 localhost kernel: NETDEV WATCHDOG: eth1: transmit timed out
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 09:21:16 localhost kernel: [<ffffffff8000c503>] __delay+0x6/0x10
Sep 13 09:21:16 localhost kernel: [<ffffffff882caed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 13 09:21:16 localhost kernel: [<ffffffff882cb27f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 13 09:21:16 localhost kernel: [<ffffffff882cb450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 13 09:21:16 localhost kernel: [<ffffffff882cd5b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 13 09:21:16 localhost kernel: [<ffffffff882d20fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 13 09:21:16 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 13 09:21:16 localhost kernel: [<ffffffff80087d09>] __activate_task+0x27/0x39
Sep 13 09:21:16 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 13 09:21:16 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 13 09:21:16 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 13 09:21:16 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 13 09:21:16 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 13 09:21:16 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 09:21:16 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 09:21:16 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 09:21:16 localhost kernel: <EOI> [<ffffffff882ca440>] :e1000:e1000_put_hw_eeprom_semaphore+0x13/0x2b
Sep 13 09:21:16 localhost kernel: [<ffffffff882cb567>] :e1000:e1000_write_phy_reg+0xd6/0xe3
Sep 13 09:21:16 localhost kernel: [<ffffffff882cd67d>] :e1000:e1000_get_speed_and_duplex+0x1c3/0x30d
Sep 13 09:21:16 localhost kernel: [<ffffffff882d20fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 13 09:21:16 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 13 09:21:16 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 13 09:21:16 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 13 09:21:16 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 13 09:21:16 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 13 09:21:16 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 13 09:21:16 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 13 09:21:16 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 13 09:21:16 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 13 09:21:16 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 13 09:21:16 localhost kernel:
Sep 13 09:34:28 localhost kernel: klogd 1.4.1, log source = /proc/kmsg started.
Sep 13 09:34:28 localhost kernel: Linux version 2.6.18-53.el5 (brewbuilder@hs20-bc1-7.build.redhat.com) (gcc version 4.1.2 20070626 (Red Hat 4.1.2-14)) #1 SMP Wed Oct 10 16:34:19 EDT 2007
Sep 13 09:34:28 localhost kernel: Command line: ro root=LABEL=/ rhgb quiet
Sep 13 09:34:28 localhost kernel: BIOS-provided physical RAM map:
Sep 13 09:34:28 localhost kernel: BIOS-e820: 0000000000000000 - 000000000009c000 (usable)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 000000000009c000 - 000000000009f400 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000000e6000 - 0000000000100000 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 0000000000100000 - 00000000bfe80000 (usable)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000bfe8e000 - 00000000bfe90000 type 9
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000bfe90000 - 00000000bfe9e000 (ACPI data)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000bfe9e000 - 00000000bfed0000 (ACPI NVS)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000bfed0000 - 00000000bfee0000 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000bfeed400 - 00000000c0000000 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000e0000000 - 00000000f0000000 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000fee00000 - 00000000fee01000 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 00000000ffb00000 - 0000000100000000 (reserved)
Sep 13 09:34:28 localhost kernel: BIOS-e820: 0000000100000000 - 0000000240000000 (usable)
Sep 13 09:34:28 localhost kernel: DMI present.
Sep 13 09:34:28 localhost kernel: No NUMA configuration found
Sep 13 09:34:28 localhost kernel: Faking a node at 0000000000000000-0000000240000000
Sep 13 09:34:28 localhost kernel: Bootmem setup node 0 0000000000000000-0000000240000000
Sep 13 09:34:28 localhost kernel: Memory for crash kernel (0x0 to 0x0) notwithin permissible range
Sep 13 09:34:28 localhost kernel: disabling kdump
Sep 13 09:34:28 localhost kernel: ACPI: PM-Timer IO Port: 0x408
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
Sep 13 09:34:28 localhost kernel: Processor #0 7:7 APIC version 20
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x02] lapic_id[0x01] enabled)
Sep 13 09:34:28 localhost kernel: Processor #1 7:7 APIC version 20
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x03] lapic_id[0x02] enabled)
Sep 13 09:34:28 localhost kernel: Processor #2 7:7 APIC version 20
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x04] lapic_id[0x03] enabled)
Sep 13 09:34:28 localhost kernel: Processor #3 7:7 APIC version 20
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x05] lapic_id[0x84] disabled)
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x06] lapic_id[0x85] disabled)
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x07] lapic_id[0x86] disabled)
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC (acpi_id[0x08] lapic_id[0x87] disabled)
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
Sep 13 09:34:28 localhost kernel: ACPI: IOAPIC (id[0x04] address[0xfec00000] gsi_base[0])
Sep 13 09:34:28 localhost kernel: IOAPIC[0]: apic_id 4, version 32, address 0xfec00000, GSI 0-23
Sep 13 09:34:28 localhost kernel: ACPI: IOAPIC (id[0x05] address[0xfec80000] gsi_base[24])
Sep 13 09:34:28 localhost kernel: IOAPIC[1]: apic_id 5, version 32, address 0xfec80000, GSI 24-47
Sep 13 09:34:28 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
Sep 13 09:34:28 localhost kernel: ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
Sep 13 09:34:28 localhost kernel: Setting APIC routing to physical flat
Sep 13 09:34:28 localhost kernel: ACPI: HPET id: 0x8086a201 base: 0xfed00000
Sep 13 09:34:28 localhost kernel: Using ACPI (MADT) for SMP configuration information
Sep 13 09:34:28 localhost kernel: Nosave address range: 000000000009c000 - 000000000009f000
Sep 13 09:34:28 localhost kernel: Nosave address range: 000000000009f000 - 00000000000e6000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000000e6000 - 0000000000100000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfe80000 - 00000000bfe8e000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfe8e000 - 00000000bfe90000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfe90000 - 00000000bfe9e000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfe9e000 - 00000000bfed0000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfed0000 - 00000000bfee0000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfee0000 - 00000000bfeee000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000bfeee000 - 00000000c0000000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000c0000000 - 00000000e0000000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000e0000000 - 00000000f0000000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000f0000000 - 00000000fee00000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000fee00000 - 00000000fee01000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000fee01000 - 00000000ffb00000
Sep 13 09:34:28 localhost kernel: Nosave address range: 00000000ffb00000 - 0000000100000000
Sep 13 09:34:28 localhost kernel: Allocating PCI resources starting at c2000000 (gap: c0000000:20000000)
Sep 13 09:34:28 localhost kernel: SMP: Allowing 8 CPUs, 4 hotplug CPUs
Sep 13 09:34:28 localhost kernel: Built 1 zonelists. Total pages: 2063170
Sep 13 09:34:28 localhost kernel: Kernel command line: ro root=LABEL=/ rhgb quiet
Sep 13 09:34:28 localhost kernel: Initializing CPU#0
Sep 13 09:34:28 localhost kernel: PID hash table entries: 4096 (order: 12, 32768 bytes)
Sep 13 09:34:28 localhost kernel: Console: colour VGA+ 80x25
Sep 13 09:34:28 localhost kernel: Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes)
Sep 13 09:34:28 localhost kernel: Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes)
Sep 13 09:34:28 localhost kernel: Checking aperture...
Sep 13 09:34:28 localhost kernel: PCI-DMA: Using software bounce buffering for IO (SWIOTLB)
Sep 13 09:34:28 localhost kernel: Placing software IO TLB between 0x1c5b000 - 0x5c5b000
Sep 13 09:34:28 localhost kernel: Memory: 8170824k/9437184k available (2434k kernel code, 215848k reserved, 1235k data, 192k init)
Sep 13 09:34:28 localhost kernel: Calibrating delay using timer specific routine.. 5656.28 BogoMIPS (lpj=2828140)
Sep 13 09:34:28 localhost kernel: Security Framework v1.0.0 initialized
Sep 13 09:34:28 localhost kernel: SELinux: Initializing.
Sep 13 09:34:28 localhost kernel: selinux_register_security: Registering secondary module capability
Sep 13 09:34:28 localhost kernel: Capability LSM initialized as secondary
Sep 13 09:34:28 localhost kernel: Mount-cache hash table entries: 256
Sep 13 09:34:28 localhost kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Sep 13 09:34:28 localhost kernel: CPU: L2 cache: 6144K
Sep 13 09:34:28 localhost kernel: using mwait in idle threads.
Sep 13 09:34:28 localhost kernel: CPU: Physical Processor ID: 0
Sep 13 09:34:28 localhost kernel: CPU: Processor Core ID: 0
Sep 13 09:34:28 localhost kernel: CPU0: Thermal monitoring enabled (TM2)
Sep 13 09:34:28 localhost kernel: SMP alternatives: switching to UP code
Sep 13 09:34:28 localhost kernel: ACPI: Core revision 20060707
Sep 13 09:34:28 localhost kernel: ACPI Warning (utinit-0077): Invalid FADT value PM2_CNT_LEN=0 at offset 5A FADT=ffff810107ec59c0 [20060707]
Sep 13 09:34:28 localhost kernel: Using local APIC timer interrupts.
Sep 13 09:34:28 localhost kernel: result 20781320
Sep 13 09:34:28 localhost kernel: Detected 20.781 MHz APIC timer.
Sep 13 09:34:28 localhost kernel: SMP alternatives: switching to SMP code
Sep 13 09:34:28 localhost kernel: Booting processor 1/4 APIC 0x1
Sep 13 09:34:28 localhost kernel: Initializing CPU#1
Sep 13 09:34:28 localhost kernel: Calibrating delay using timer specific routine.. 5652.47 BogoMIPS (lpj=2826237)
Sep 13 09:34:28 localhost kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Sep 13 09:34:28 localhost kernel: CPU: L2 cache: 6144K
Sep 13 09:34:28 localhost kernel: CPU: Physical Processor ID: 0
Sep 13 09:34:28 localhost kernel: CPU: Processor Core ID: 1
Sep 13 09:34:28 localhost kernel: CPU1: Thermal monitoring enabled (TM2)
Sep 13 09:34:28 localhost kernel: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06
Sep 13 09:34:28 localhost kernel: SMP alternatives: switching to SMP code
Sep 13 09:34:28 localhost kernel: Booting processor 2/4 APIC 0x2
Sep 13 09:34:28 localhost kernel: Initializing CPU#2
Sep 13 09:34:28 localhost kernel: Calibrating delay using timer specific routine.. 5652.51 BogoMIPS (lpj=2826259)
Sep 13 09:34:28 localhost kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Sep 13 09:34:28 localhost kernel: CPU: L2 cache: 6144K
Sep 13 09:34:28 localhost kernel: CPU: Physical Processor ID: 0
Sep 13 09:34:28 localhost kernel: CPU: Processor Core ID: 2
Sep 13 09:34:28 localhost kernel: CPU2: Thermal monitoring enabled (TM2)
Sep 13 09:34:28 localhost kernel: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06
Sep 13 09:34:28 localhost kernel: SMP alternatives: switching to SMP code
Sep 13 09:34:28 localhost kernel: Booting processor 3/4 APIC 0x3
Sep 13 09:34:28 localhost kernel: Initializing CPU#3
Sep 13 09:34:28 localhost kernel: Calibrating delay using timer specific routine.. 5652.51 BogoMIPS (lpj=2826256)
Sep 13 09:34:28 localhost kernel: CPU: L1 I cache: 32K, L1 D cache: 32K
Sep 13 09:34:28 localhost kernel: CPU: L2 cache: 6144K
Sep 13 09:34:28 localhost kernel: CPU: Physical Processor ID: 0
Sep 13 09:34:28 localhost kernel: CPU: Processor Core ID: 3
Sep 13 09:34:28 localhost kernel: CPU3: Thermal monitoring enabled (TM2)
Sep 13 09:34:28 localhost kernel: Intel(R) Xeon(R) CPU E5440 @ 2.83GHz stepping 06
Sep 13 09:34:28 localhost kernel: Brought up 4 CPUs
Sep 13 09:34:28 localhost kernel: testing NMI watchdog ... OK.
Sep 13 09:34:28 localhost kernel: time.c: Using 14.318180 MHz WALL HPET GTOD HPET/TSC timer.
Sep 13 09:34:28 localhost kernel: time.c: Detected 2826.261 MHz processor.
Sep 13 09:34:28 localhost kernel: migration_cost=23,10880
Sep 13 09:34:28 localhost kernel: checking if image is initramfs... it is
Sep 13 09:34:28 localhost kernel: Freeing initrd memory: 2921k freed
Sep 13 09:34:28 localhost kernel: NET: Registered protocol family 16
Sep 13 09:34:28 localhost kernel: ACPI: bus type pci registered
Sep 13 09:34:28 localhost kernel: PCI: Using MMCONFIG at e0000000
Sep 13 09:34:28 localhost kernel: ACPI: Interpreter enabled
Sep 13 09:34:28 localhost kernel: ACPI: Using IOAPIC for interrupt routing
Sep 13 09:34:28 localhost kernel: Error attaching device data
Sep 13 09:34:28 localhost kernel: ACPI: PCI Root Bridge [PCI0] (0000:00)
Sep 13 09:34:28 localhost kernel: PCI: Ignoring BAR0-3 of IDE controller 0000:00:1f.1
Sep 13 09:34:28 localhost kernel: PCI: Transparent bridge - 0000:00:1e.0
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKA] (IRQs 3 4 5 6 7 *10 11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKB] (IRQs 3 4 5 6 7 *11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKC] (IRQs 3 4 5 6 7 10 *11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKD] (IRQs 3 4 *5 6 7 10 11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKE] (IRQs 3 4 5 6 7 *10 11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKF] (IRQs 3 4 *5 6 7 10 11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKG] (IRQs 3 4 5 6 *7 10 11 12 14 15)
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt Link [LNKH] (IRQs 3 4 5 *6 7 10 11 12 14 15)
Sep 13 09:34:28 localhost kernel: Linux Plug and Play Support v0.97 (c) Adam Belay
Sep 13 09:34:28 localhost kernel: pnp: PnP ACPI init
Sep 13 09:34:28 localhost kernel: pnp: PnP ACPI: found 15 devices
Sep 13 09:34:28 localhost kernel: usbcore: registered new driver usbfs
Sep 13 09:34:28 localhost kernel: usbcore: registered new driver hub
Sep 13 09:34:28 localhost kernel: PCI: Using ACPI for IRQ routing
Sep 13 09:34:28 localhost kernel: PCI: If a device doesn't work, try "pci=routeirq". If it helps, post a report
Sep 13 09:34:28 localhost kernel: NetLabel: Initializing
Sep 13 09:34:28 localhost kernel: NetLabel: domain hash size = 128
Sep 13 09:34:28 localhost kernel: NetLabel: protocols = UNLABELED CIPSOv4
Sep 13 09:34:28 localhost kernel: NetLabel: unlabeled traffic allowed by default
Sep 13 09:34:28 localhost kernel: hpet0: at MMIO 0xfed00000 (virtual 0xffffffffff5fe000), IRQs 2, 8, 0
Sep 13 09:34:28 localhost kernel: hpet0: 3 64-bit timers, 14318180 Hz
Sep 13 09:34:28 localhost kernel: PCI-GART: No AMD northbridge found.
Sep 13 09:34:28 localhost kernel: pnp: 00:08: ioport range 0x800-0x81f has been reserved
Sep 13 09:34:28 localhost kernel: pnp: 00:08: ioport range 0x830-0x83f has been reserved
Sep 13 09:34:28 localhost kernel: pnp: 00:08: ioport range 0x820-0x82f could not be reserved
Sep 13 09:34:28 localhost kernel: pnp: 00:08: ioport range 0x840-0x84f has been reserved
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:02:00.0
Sep 13 09:34:28 localhost kernel: IO window: b000-bfff
Sep 13 09:34:28 localhost kernel: MEM window: c6f00000-c70fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:02:02.0
Sep 13 09:34:28 localhost kernel: IO window: c000-cfff
Sep 13 09:34:28 localhost kernel: MEM window: c7100000-c71fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:01:00.0
Sep 13 09:34:28 localhost kernel: IO window: b000-cfff
Sep 13 09:34:28 localhost kernel: MEM window: c6f00000-c71fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:01:00.3
Sep 13 09:34:28 localhost kernel: IO window: disabled.
Sep 13 09:34:28 localhost kernel: MEM window: disabled.
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:02.0
Sep 13 09:34:28 localhost kernel: IO window: b000-cfff
Sep 13 09:34:28 localhost kernel: MEM window: c6e00000-c71fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:03.0
Sep 13 09:34:28 localhost kernel: IO window: disabled.
Sep 13 09:34:28 localhost kernel: MEM window: disabled.
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:04.0
Sep 13 09:34:28 localhost kernel: IO window: d000-dfff
Sep 13 09:34:28 localhost kernel: MEM window: c7200000-c72fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:05.0
Sep 13 09:34:28 localhost kernel: IO window: disabled.
Sep 13 09:34:28 localhost kernel: MEM window: disabled.
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:06.0
Sep 13 09:34:28 localhost kernel: IO window: disabled.
Sep 13 09:34:28 localhost kernel: MEM window: c7300000-d32fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:07.0
Sep 13 09:34:28 localhost kernel: IO window: disabled.
Sep 13 09:34:28 localhost kernel: MEM window: d3300000-df2fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:1c.0
Sep 13 09:34:28 localhost kernel: IO window: disabled.
Sep 13 09:34:28 localhost kernel: MEM window: df300000-df5fffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: PCI: Ignore bogus resource 6 [0:0] of 0000:1a:05.0
Sep 13 09:34:28 localhost kernel: PCI: Bridge: 0000:00:1e.0
Sep 13 09:34:28 localhost kernel: IO window: e000-efff
Sep 13 09:34:28 localhost kernel: MEM window: df700000-dfffffff
Sep 13 09:34:28 localhost kernel: PREFETCH window: disabled.
Sep 13 09:34:28 localhost kernel: GSI 16 sharing vector 0xA9 and IRQ 16
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:01:00.0[A] -> GSI 16 (level, low) -> IRQ 169
Sep 13 09:34:28 localhost kernel: GSI 17 sharing vector 0xB1 and IRQ 17
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1c.0[A] -> GSI 17 (level, low) -> IRQ 177
Sep 13 09:34:28 localhost kernel: NET: Registered protocol family 2
Sep 13 09:34:28 localhost kernel: IP route cache hash table entries: 262144 (order: 9, 2097152 bytes)
Sep 13 09:34:28 localhost kernel: TCP established hash table entries: 262144 (order: 10, 4194304 bytes)
Sep 13 09:34:28 localhost kernel: TCP bind hash table entries: 65536 (order: 8, 1048576 bytes)
Sep 13 09:34:28 localhost kernel: TCP: Hash tables configured (established 262144 bind 65536)
Sep 13 09:34:28 localhost kernel: TCP reno registered
Sep 13 09:34:28 localhost kernel: audit: initializing netlink socket (disabled)
Sep 13 09:34:28 localhost kernel: audit(1284370399.809:1): initialized
Sep 13 09:34:28 localhost kernel: Total HugeTLB memory allocated, 0
Sep 13 09:34:28 localhost kernel: VFS: Disk quotas dquot_6.5.1
Sep 13 09:34:28 localhost kernel: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)
Sep 13 09:34:28 localhost kernel: Initializing Cryptographic API
Sep 13 09:34:28 localhost kernel: ksign: Installing public key data
Sep 13 09:34:28 localhost kernel: Loading keyring
Sep 13 09:34:28 localhost kernel: - Added public key 836E299A424CB51A
Sep 13 09:34:28 localhost kernel: - User ID: Red Hat, Inc. (Kernel Module GPG key)
Sep 13 09:34:28 localhost kernel: io scheduler noop registered
Sep 13 09:34:28 localhost kernel: io scheduler anticipatory registered
Sep 13 09:34:28 localhost kernel: io scheduler deadline registered
Sep 13 09:34:28 localhost kernel: io scheduler cfq registered (default)
Sep 13 09:34:28 localhost kernel: assign_interrupt_mode Found MSI capability
Sep 13 09:34:28 localhost kernel: pci_hotplug: PCI Hot Plug PCI Core version: 0.5
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [DpgPmm] OemTableId [ P001Ist] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [ PmRef] OemTableId [ P001Cst] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: CPU0 (power states: C1[C1] C2[C2])
Sep 13 09:34:28 localhost kernel: ACPI: Processor [P001] (supports 8 throttling states)
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [DpgPmm] OemTableId [ P002Ist] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [ PmRef] OemTableId [ P002Cst] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: CPU1 (power states: C1[C1] C2[C2])
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [DpgPmm] OemTableId [ P003Ist] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [ PmRef] OemTableId [ P003Cst] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: CPU2 (power states: C1[C1] C2[C2])
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [DpgPmm] OemTableId [ P004Ist] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI (exconfig-0455): Dynamic SSDT Load - OemId [ PmRef] OemTableId [ P004Cst] [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: CPU3 (power states: C1[C1] C2[C2])
Sep 13 09:34:28 localhost kernel: ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is not present [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: Getting cpuindex for acpiid 0x5
Sep 13 09:34:28 localhost kernel: ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is not present [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: Getting cpuindex for acpiid 0x6
Sep 13 09:34:28 localhost kernel: ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is not present [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: Getting cpuindex for acpiid 0x7
Sep 13 09:34:28 localhost kernel: ACPI Exception (acpi_processor-0681): AE_NOT_FOUND, Processor Device is not present [20060707]
Sep 13 09:34:28 localhost kernel: ACPI: Getting cpuindex for acpiid 0x8
Sep 13 09:34:28 localhost kernel: Real Time Clock Driver v1.12ac
Sep 13 09:34:28 localhost kernel: Non-volatile memory driver v1.2
Sep 13 09:34:28 localhost kernel: Linux agpgart interface v0.101 (c) Dave Jones
Sep 13 09:34:28 localhost kernel: Serial: 8250/16550 driver $Revision: 1.90 $ 4 ports, IRQ sharing enabled
Sep 13 09:34:28 localhost kernel: serial8250: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Sep 13 09:34:28 localhost kernel: serial8250: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Sep 13 09:34:28 localhost kernel: 00:06: ttyS0 at I/O 0x3f8 (irq = 4) is a 16550A
Sep 13 09:34:28 localhost kernel: 00:07: ttyS1 at I/O 0x2f8 (irq = 3) is a 16550A
Sep 13 09:34:28 localhost kernel: RAMDISK driver initialized: 16 RAM disks of 16384K size 4096 blocksize
Sep 13 09:34:28 localhost kernel: Uniform Multi-Platform E-IDE driver Revision: 7.00alpha2
Sep 13 09:34:28 localhost kernel: ide: Assuming 33MHz system bus speed for PIO modes; override with idebus=xx
Sep 13 09:34:28 localhost kernel: ESB2: IDE controller at PCI slot 0000:00:1f.1
Sep 13 09:34:28 localhost kernel: GSI 18 sharing vector 0x4A and IRQ 18
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1f.1[A] -> GSI 20 (level, low) -> IRQ 74
Sep 13 09:34:28 localhost kernel: ESB2: chipset revision 9
Sep 13 09:34:28 localhost kernel: ESB2: not 100% native mode: will probe irqs later
Sep 13 09:34:28 localhost kernel: ide0: BM-DMA at 0xffa0-0xffa7, BIOS settings: hda:pio, hdb:pio
Sep 13 09:34:28 localhost kernel: ide1: BM-DMA at 0xffa8-0xffaf, BIOS settings: hdc:pio, hdd:pio
Sep 13 09:34:28 localhost kernel: ide-floppy driver 0.99.newide
Sep 13 09:34:28 localhost kernel: usbcore: registered new driver hiddev
Sep 13 09:34:28 localhost kernel: usbcore: registered new driver usbhid
Sep 13 09:34:28 localhost kernel: drivers/usb/input/hid-core.c: v2.6:USB HID core driver
Sep 13 09:34:28 localhost kernel: PNP: No PS/2 controller found. Probing ports directly.
Sep 13 09:34:28 localhost kernel: serio: i8042 KBD port at 0x60,0x64 irq 1
Sep 13 09:34:28 localhost kernel: serio: i8042 AUX port at 0x60,0x64 irq 12
Sep 13 09:34:28 localhost kernel: mice: PS/2 mouse device common for all mice
Sep 13 09:34:28 localhost kernel: md: md driver 0.90.3 MAX_MD_DEVS=256, MD_SB_DISKS=27
Sep 13 09:34:28 localhost kernel: md: bitmap version 4.39
Sep 13 09:34:28 localhost kernel: TCP bic registered
Sep 13 09:34:28 localhost kernel: Initializing IPsec netlink socket
Sep 13 09:34:28 localhost kernel: NET: Registered protocol family 1
Sep 13 09:34:28 localhost kernel: NET: Registered protocol family 17
Sep 13 09:34:28 localhost kernel: ACPI: (supports S0 S1 S5)
Sep 13 09:34:28 localhost kernel: Freeing unused kernel memory: 192k freed
Sep 13 09:34:28 localhost kernel: Write protecting the kernel read-only data: 468k
Sep 13 09:34:28 localhost kernel: SCSI subsystem initialized
Sep 13 09:34:28 localhost kernel: QLogic Fibre Channel HBA Driver: 8.02.14
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:0a:00.0[A] -> GSI 17 (level, low) -> IRQ 177
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Found an ISP2432, irq 177, iobase 0xffffc20000020000
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Configuring PCI space...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Configure NVRAM parameters...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Verifying loaded RISC code...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Allocated (64 KB) for EFT...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Allocated (1413 KB) for firmware dump...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Waiting for LIP to complete...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: LIP reset occured (f700).
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: LOOP UP detected (4 Gbps).
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: Topology - (F_Port), Host Loop address 0x0
Sep 13 09:34:28 localhost kernel: scsi0 : qla2xxx
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0:
Sep 13 09:34:28 localhost kernel: QLogic Fibre Channel HBA Driver: 8.02.14
Sep 13 09:34:28 localhost kernel: QLogic QEM2462 - Sun Server I/O Module 4Gb FC, Dual Channel
Sep 13 09:34:28 localhost kernel: ISP2432: PCIe (2.5GT/s x4) @ 0000:0a:00.0 hdma+, host#=0, fw=4.04.00 [IP] [84XX]
Sep 13 09:34:28 localhost kernel: Vendor: NETAPP Model: LUN Rev: 7320
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 04
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: scsi(0:0:1:1): Enabled tagged queuing, queue depth 32.
Sep 13 09:34:28 localhost kernel: SCSI device sda: 104857600 512-byte hdwr sectors (53687 MB)
Sep 13 09:34:28 localhost kernel: sda: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sda: drive cache: write through
Sep 13 09:34:28 localhost kernel: SCSI device sda: 104857600 512-byte hdwr sectors (53687 MB)
Sep 13 09:34:28 localhost kernel: sda: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sda: drive cache: write through
Sep 13 09:34:28 localhost kernel: sda: unknown partition table
Sep 13 09:34:28 localhost kernel: sd 0:0:1:1: Attached scsi disk sda
Sep 13 09:34:28 localhost kernel: Vendor: NETAPP Model: LUN Rev: 7320
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 04
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.0: scsi(0:0:1:2): Enabled tagged queuing, queue depth 32.
Sep 13 09:34:28 localhost kernel: SCSI device sdb: 209715200 512-byte hdwr sectors (107374 MB)
Sep 13 09:34:28 localhost kernel: sdb: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sdb: drive cache: write through
Sep 13 09:34:28 localhost kernel: SCSI device sdb: 209715200 512-byte hdwr sectors (107374 MB)
Sep 13 09:34:28 localhost kernel: sdb: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sdb: drive cache: write through
Sep 13 09:34:28 localhost kernel: sdb: unknown partition table
Sep 13 09:34:28 localhost kernel: sd 0:0:1:2: Attached scsi disk sdb
Sep 13 09:34:28 localhost kernel: GSI 19 sharing vector 0x52 and IRQ 19
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:0a:00.1-B- -> GSI 18 (level, low) -> IRQ 82
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Found an ISP2432, irq 82, iobase 0xffffc20000022000
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Configuring PCI space...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Configure NVRAM parameters...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Verifying loaded RISC code...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Allocated (64 KB) for EFT...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Allocated (1413 KB) for firmware dump...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Waiting for LIP to complete...
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: LIP reset occured (f700).
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: LIP occured (f700).
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: LIP reset occured (f7f7).
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: LOOP UP detected (4 Gbps).
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: Topology - (F_Port), Host Loop address 0x0
Sep 13 09:34:28 localhost kernel: scsi1 : qla2xxx
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1:
Sep 13 09:34:28 localhost kernel: QLogic Fibre Channel HBA Driver: 8.02.14
Sep 13 09:34:28 localhost kernel: QLogic QEM2462 - Sun Server I/O Module 4Gb FC, Dual Channel
Sep 13 09:34:28 localhost kernel: ISP2432: PCIe (2.5GT/s x4) @ 0000:0a:00.1 hdma+, host#=1, fw=4.04.00 [IP] [84XX]
Sep 13 09:34:28 localhost kernel: Vendor: NETAPP Model: LUN Rev: 7320
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 04
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: scsi(1:0:1:1): Enabled tagged queuing, queue depth 32.
Sep 13 09:34:28 localhost kernel: SCSI device sdc: 104857600 512-byte hdwr sectors (53687 MB)
Sep 13 09:34:28 localhost kernel: sdc: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sdc: drive cache: write through
Sep 13 09:34:28 localhost kernel: SCSI device sdc: 104857600 512-byte hdwr sectors (53687 MB)
Sep 13 09:34:28 localhost kernel: sdc: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sdc: drive cache: write through
Sep 13 09:34:28 localhost kernel: sdc: unknown partition table
Sep 13 09:34:28 localhost kernel: sd 1:0:1:1: Attached scsi disk sdc
Sep 13 09:34:28 localhost kernel: Vendor: NETAPP Model: LUN Rev: 7320
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 04
Sep 13 09:34:28 localhost kernel: qla2xxx 0000:0a:00.1: scsi(1:0:1:2): Enabled tagged queuing, queue depth 32.
Sep 13 09:34:28 localhost kernel: SCSI device sdd: 209715200 512-byte hdwr sectors (107374 MB)
Sep 13 09:34:28 localhost kernel: sdd: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sdd: drive cache: write through
Sep 13 09:34:28 localhost kernel: SCSI device sdd: 209715200 512-byte hdwr sectors (107374 MB)
Sep 13 09:34:28 localhost kernel: sdd: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sdd: drive cache: write through
Sep 13 09:34:28 localhost kernel: sdd: unknown partition table
Sep 13 09:34:28 localhost kernel: sd 1:0:1:2: Attached scsi disk sdd
Sep 13 09:34:28 localhost kernel: USB Universal Host Controller Interface driver v3.0
Sep 13 09:34:28 localhost kernel: GSI 20 sharing vector 0x5A and IRQ 20
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1d.0[A] -> GSI 22 (level, low) -> IRQ 90
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.0: UHCI Host Controller
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.0: new USB bus registered, assigned bus number 1
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.0: irq 90, io base 0x0000a800
Sep 13 09:34:28 localhost kernel: usb usb1: configuration #1 chosen from 1 choice
Sep 13 09:34:28 localhost kernel: hub 1-0:1.0: USB hub found
Sep 13 09:34:28 localhost kernel: hub 1-0:1.0: 2 ports detected
Sep 13 09:34:28 localhost kernel: GSI 21 sharing vector 0x62 and IRQ 21
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1d.1-B- -> GSI 23 (level, low) -> IRQ 98
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.1: UHCI Host Controller
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.1: new USB bus registered, assigned bus number 2
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.1: irq 98, io base 0x0000a400
Sep 13 09:34:28 localhost kernel: usb usb2: configuration #1 chosen from 1 choice
Sep 13 09:34:28 localhost kernel: hub 2-0:1.0: USB hub found
Sep 13 09:34:28 localhost kernel: hub 2-0:1.0: 2 ports detected
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1d.2[C] -> GSI 20 (level, low) -> IRQ 74
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.2: UHCI Host Controller
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.2: new USB bus registered, assigned bus number 3
Sep 13 09:34:28 localhost kernel: uhci_hcd 0000:00:1d.2: irq 74, io base 0x0000a000
Sep 13 09:34:28 localhost kernel: usb usb3: configuration #1 chosen from 1 choice
Sep 13 09:34:28 localhost kernel: hub 3-0:1.0: USB hub found
Sep 13 09:34:28 localhost kernel: hub 3-0:1.0: 2 ports detected
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1d.7[A] -> GSI 22 (level, low) -> IRQ 90
Sep 13 09:34:28 localhost kernel: usb 1-1: new low speed USB device using uhci_hcd and address 2
Sep 13 09:34:28 localhost kernel: ehci_hcd 0000:00:1d.7: EHCI Host Controller
Sep 13 09:34:28 localhost kernel: ehci_hcd 0000:00:1d.7: new USB bus registered, assigned bus number 4
Sep 13 09:34:28 localhost kernel: ehci_hcd 0000:00:1d.7: debug port 1
Sep 13 09:34:28 localhost kernel: ehci_hcd 0000:00:1d.7: irq 90, io mem 0xdf6ffc00
Sep 13 09:34:28 localhost kernel: ehci_hcd 0000:00:1d.7: USB 2.0 started, EHCI 1.00, driver 10 Dec 2004
Sep 13 09:34:28 localhost kernel: usb usb4: configuration #1 chosen from 1 choice
Sep 13 09:34:28 localhost kernel: hub 4-0:1.0: USB hub found
Sep 13 09:34:28 localhost kernel: hub 4-0:1.0: 6 ports detected
Sep 13 09:34:28 localhost kernel: Adaptec aacraid driver 1.1-5[2437]-mh4
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:19:00.0[A] -> GSI 16 (level, low) -> IRQ 169
Sep 13 09:34:28 localhost kernel: AAC0: kernel 5.2-0[15595] Feb 28 2008
Sep 13 09:34:28 localhost kernel: AAC0: monitor 5.2-0[15595]
Sep 13 09:34:28 localhost kernel: AAC0: bios 5.2-0[15595]
Sep 13 09:34:28 localhost kernel: AAC0: serial 001148
Sep 13 09:34:28 localhost kernel: AAC0: Non-DASD support enabled.
Sep 13 09:34:28 localhost kernel: AAC0: 64bit support enabled.
Sep 13 09:34:28 localhost kernel: AAC0: 64 Bit DAC enabled
Sep 13 09:34:28 localhost kernel: scsi2 : aacraid
Sep 13 09:34:28 localhost kernel: Vendor: Sun Model: Mirror Rev: V1.0
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 02
Sep 13 09:34:28 localhost kernel: SCSI device sde: 143134720 512-byte hdwr sectors (73285 MB)
Sep 13 09:34:28 localhost kernel: sde: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sde: drive cache: write back w/ FUA
Sep 13 09:34:28 localhost kernel: SCSI device sde: 143134720 512-byte hdwr sectors (73285 MB)
Sep 13 09:34:28 localhost kernel: sde: Write Protect is off
Sep 13 09:34:28 localhost kernel: SCSI device sde: drive cache: write back w/ FUA
Sep 13 09:34:28 localhost kernel: sde: sde1 sde2 sde3
Sep 13 09:34:28 localhost kernel: sd 2:0:0:0: Attached scsi removable disk sde
Sep 13 09:34:28 localhost kernel: Vendor: SEAGATE Model: ST973402SSUN72G Rev: 0603
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 05
Sep 13 09:34:28 localhost kernel: Vendor: SEAGATE Model: ST973402SSUN72G Rev: 0603
Sep 13 09:34:28 localhost kernel: Type: Direct-Access ANSI SCSI revision: 05
Sep 13 09:34:28 localhost kernel: Vendor: ADAPTEC Model: Virtual SGPIO 0 Rev: 0001
Sep 13 09:34:28 localhost kernel: Type: Enclosure ANSI SCSI revision: 05
Sep 13 09:34:28 localhost kernel: usb 1-1: new low speed USB device using uhci_hcd and address 3
Sep 13 09:34:28 localhost kernel: ata_piix 0000:00:1f.2: MAP [ P0 P2 P1 P3 ]
Sep 13 09:34:28 localhost kernel: GSI 22 sharing vector 0x6A and IRQ 22
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1f.2-B- -> GSI 21 (level, low) -> IRQ 106
Sep 13 09:34:28 localhost kernel: scsi3 : ata_piix
Sep 13 09:34:28 localhost kernel: scsi4 : ata_piix
Sep 13 09:34:28 localhost kernel: ata1: SATA max UDMA/133 cmd 0x0000000000019800 ctl 0x0000000000019402 bmdma 0x0000000000018400 irq 106
Sep 13 09:34:28 localhost kernel: ata2: SATA max UDMA/133 cmd 0x0000000000019000 ctl 0x0000000000018802 bmdma 0x0000000000018408 irq 106
Sep 13 09:34:28 localhost kernel: usb 1-1: configuration #1 chosen from 1 choice
Sep 13 09:34:28 localhost kernel: input: American Megatrends Inc. Virtual Keyboard and Mouse as /class/input/input0
Sep 13 09:34:28 localhost kernel: input: USB HID v1.10 Keyboard [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1
Sep 13 09:34:28 localhost kernel: input: American Megatrends Inc. Virtual Keyboard and Mouse as /class/input/input1
Sep 13 09:34:28 localhost kernel: input: USB HID v1.10 Mouse [American Megatrends Inc. Virtual Keyboard and Mouse] on usb-0000:00:1d.0-1
Sep 13 09:34:28 localhost kernel: Initializing USB Mass Storage driver...
Sep 13 09:34:28 localhost kernel: usbcore: registered new driver usb-storage
Sep 13 09:34:28 localhost kernel: USB Mass Storage support registered.
Sep 13 09:34:28 localhost kernel: EXT3-fs: INFO: recovery required on readonly filesystem.
Sep 13 09:34:28 localhost kernel: EXT3-fs: write access will be enabled during recovery.
Sep 13 09:34:28 localhost kernel: kjournald starting. Commit interval 5 seconds
Sep 13 09:34:28 localhost kernel: EXT3-fs: sde3: orphan cleanup on readonly fs
Sep 13 09:34:28 localhost kernel: EXT3-fs: sde3: 1 orphan inode deleted
Sep 13 09:34:28 localhost kernel: EXT3-fs: recovery complete.
Sep 13 09:34:28 localhost kernel: EXT3-fs: mounted filesystem with ordered data mode.
Sep 13 09:34:28 localhost kernel: audit(1284370417.708:2): enforcing=1 old_enforcing=0 auid=4294967295
Sep 13 09:34:28 localhost kernel: audit(1284370418.030:3): policy loaded auid=4294967295
Sep 13 09:34:28 localhost kernel: input: PC Speaker as /class/input/input2
Sep 13 09:34:28 localhost kernel: Intel(R) PRO/1000 Network Driver - version 7.3.20-k2-NAPI
Sep 13 09:34:28 localhost kernel: Copyright (c) 1999-2006 Intel Corporation.
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:07:00.0[A] -> GSI 18 (level, low) -> IRQ 82
Sep 13 09:34:28 localhost kernel: intel_rng: FWH not detected
Sep 13 09:34:28 localhost kernel: e1000: 0000:07:00.0: e1000_probe: (PCI Express:2.5Gb/s:32-bit) 00:1e:68:a9:96:78
Sep 13 09:34:28 localhost kernel: sd 0:0:1:1: Attached scsi generic sg0 type 0
Sep 13 09:34:28 localhost kernel: sd 0:0:1:2: Attached scsi generic sg1 type 0
Sep 13 09:34:28 localhost kernel: sd 1:0:1:1: Attached scsi generic sg2 type 0
Sep 13 09:34:28 localhost kernel: sd 1:0:1:2: Attached scsi generic sg3 type 0
Sep 13 09:34:28 localhost kernel: sd 2:0:0:0: Attached scsi generic sg4 type 0
Sep 13 09:34:28 localhost kernel: scsi 2:1:0:0: Attached scsi generic sg5 type 0
Sep 13 09:34:28 localhost kernel: scsi 2:1:1:0: Attached scsi generic sg6 type 0
Sep 13 09:34:28 localhost kernel: scsi 2:3:0:0: Attached scsi generic sg7 type 13
Sep 13 09:34:28 localhost kernel: e1000: eth0: e1000_probe: Intel(R) PRO/1000 Network Connection
Sep 13 09:34:28 localhost kernel: GSI 23 sharing vector 0x72 and IRQ 23
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:07:00.1-B- -> GSI 19 (level, low) -> IRQ 114
Sep 13 09:34:28 localhost kernel: e1000: 0000:07:00.1: e1000_probe: (PCI Express:2.5Gb/s:32-bit) 00:1e:68:a9:96:79
Sep 13 09:34:28 localhost kernel: e1000: eth1: e1000_probe: Intel(R) PRO/1000 Network Connection
Sep 13 09:34:28 localhost kernel: shpchp: Standard Hot Plug PCI Controller Driver version: 0.4
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:00:1f.3[C] -> GSI 22 (level, low) -> IRQ 90
Sep 13 09:34:28 localhost kernel: ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver - version 2.0.62.4-NAPI
Sep 13 09:34:28 localhost kernel: Copyright (c) 1999-2010 Intel Corporation.
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:03:00.0[A] -> GSI 16 (level, low) -> IRQ 169
Sep 13 09:34:28 localhost kernel: ixgbe: 0000:03:00.0: ixgbe_init_interrupt_scheme: Multiqueue Enabled: Rx Queue count = 4, Tx Queue count = 1
Sep 13 09:34:28 localhost kernel: ixgbe: eth2: ixgbe_probe: (PCI Express:2.5Gb/s:Width x8) 00:1b:21:5f:e6:89
Sep 13 09:34:28 localhost kernel: ixgbe: eth2: ixgbe_probe: MAC: 1, PHY: 7, PBA No: e37054-006
Sep 13 09:34:28 localhost kernel: ixgbe: eth2: ixgbe_probe: Internal LRO is enabled
Sep 13 09:34:28 localhost kernel: ixgbe: eth2: ixgbe_probe: Intel(R) 10 Gigabit Network Connection
Sep 13 09:34:28 localhost kernel: ACPI: PCI Interrupt 0000:03:00.1-B- -> GSI 17 (level, low) -> IRQ 177
Sep 13 09:34:28 localhost kernel: ixgbe: 0000:03:00.1: ixgbe_init_interrupt_scheme: Multiqueue Enabled: Rx Queue count = 4, Tx Queue count = 1
Sep 13 09:34:28 localhost kernel: ixgbe: eth3: ixgbe_probe: (PCI Express:2.5Gb/s:Width x8) 00:1b:21:5f:e6:88
Sep 13 09:34:28 localhost kernel: ixgbe: eth3: ixgbe_probe: MAC: 1, PHY: 7, PBA No: e37054-006
Sep 13 09:34:28 localhost kernel: ixgbe: eth3: ixgbe_probe: Internal LRO is enabled
Sep 13 09:34:28 localhost kernel: ixgbe: eth3: ixgbe_probe: Intel(R) 10 Gigabit Network Connection
Sep 13 09:34:28 localhost kernel: floppy0: no floppy controllers found
Sep 13 09:34:28 localhost kernel: lp: driver loaded but no devices found
Sep 13 09:34:28 localhost kernel: NET: Registered protocol family 10
Sep 13 09:34:28 localhost kernel: lo: Disabled Privacy Extensions
Sep 13 09:34:28 localhost kernel: IPv6 over IPv4 tunneling driver
Sep 13 09:34:28 localhost kernel: mtrr: type mismatch for df800000,800000 old: write-back new: write-combining
Sep 13 09:34:28 localhost kernel: ACPI: Power Button (FF) [PWRF]
Sep 13 09:34:28 localhost kernel: ACPI: Power Button (CM) [PWRB]
Sep 13 09:34:28 localhost kernel: ibm_acpi: ec object not found
Sep 13 09:34:28 localhost kernel: md: Autodetecting RAID arrays.
Sep 13 09:34:28 localhost kernel: md: autorun ...
Sep 13 09:34:28 localhost kernel: md: ... autorun DONE.
Sep 13 09:34:28 localhost kernel: device-mapper: ioctl: 4.11.0-ioctl (2006-09-14) initialised: dm-devel@redhat.com
Sep 13 09:34:28 localhost kernel: device-mapper: multipath: version 1.0.5 loaded
Sep 13 09:34:28 localhost kernel: device-mapper: multipath round-robin: version 1.0.0 loaded
Sep 13 09:34:28 localhost kernel: EXT3 FS on sde3, internal journal
Sep 13 09:34:28 localhost kernel: kjournald starting. Commit interval 5 seconds
Sep 13 09:34:28 localhost kernel: EXT3 FS on sde1, internal journal
Sep 13 09:34:28 localhost kernel: EXT3-fs: mounted filesystem with ordered data mode.
Sep 13 09:34:28 localhost kernel: kjournald starting. Commit interval 5 seconds
Sep 13 09:34:28 localhost kernel: EXT3 FS on dm-2, internal journal
Sep 13 09:34:28 localhost kernel: EXT3-fs: recovery complete.
Sep 13 09:34:28 localhost kernel: EXT3-fs: mounted filesystem with ordered data mode.
Sep 13 09:34:28 localhost kernel: Adding 4192956k swap on /dev/sde2. Priority:-1 extents:1 across:4192956k
Sep 13 09:34:28 localhost kernel: IA-32 Microcode Update Driver: v1.14a <tigran@veritas.com>
Sep 13 09:34:28 localhost kernel: ip6_tables: (C) 2000-2006 Netfilter Core Team
Sep 13 09:34:28 localhost kernel: ip_tables: (C) 2000-2006 Netfilter Core Team
Sep 13 09:34:28 localhost kernel: Netfilter messages via NETLINK v0.30.
Sep 13 09:34:28 localhost kernel: ip_conntrack version 2.4 (8192 buckets, 65536 max) - 304 bytes per conntrack
Sep 13 09:34:28 localhost kernel: Ethernet Channel Bonding Driver: v3.1.2 (January 20, 2007)
Sep 13 09:34:28 localhost kernel: bonding: In ALB mode you might experience client disconnections upon reconnection of a link if the bonding module updelay parameter (0 msec) is incompatible with the forwarding delay time of the switch
Sep 13 09:34:28 localhost kernel: bonding: MII link monitoring set to 100 ms
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_UP): bond0: link is not ready
Sep 13 09:34:28 localhost kernel: bonding: bond0: Adding slave eth0.
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_UP): eth0: link is not ready
Sep 13 09:34:28 localhost kernel: e1000: eth0: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Sep 13 09:34:28 localhost kernel: bonding: bond0: making interface eth0 the new active one.
Sep 13 09:34:28 localhost kernel: bonding: bond0: enslaving eth0 as an active interface with an up link.
Sep 13 09:34:28 localhost kernel: bonding: bond0: Adding slave eth1.
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_UP): eth1: link is not ready
Sep 13 09:34:28 localhost kernel: e1000: eth1: e1000_watchdog_task: NIC Link is Up 1000 Mbps Full Duplex, Flow Control: RX/TX
Sep 13 09:34:28 localhost kernel: bonding: bond0: enslaving eth1 as an active interface with an up link.
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_CHANGE): eth0: link becomes ready
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_CHANGE): bond0: link becomes ready
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_CHANGE): eth1: link becomes ready
Sep 13 09:34:28 localhost kernel: bond0: duplicate address detected!
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_UP): eth2: link is not ready
Sep 13 09:34:28 localhost kernel: ixgbe: eth2: ixgbe_watchdog_task: NIC Link is Up 10 Gbps, Flow Control: RX/TX
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_CHANGE): eth2: link becomes ready
Sep 13 09:34:28 localhost kernel: ADDRCONF(NETDEV_UP): eth3: link is not ready
Sep 13 09:34:28 localhost kernel: Bluetooth: Core ver 2.10
Sep 13 09:34:28 localhost kernel: NET: Registered protocol family 31
Sep 13 09:34:28 localhost kernel: Bluetooth: HCI device and connection manager initialized
Sep 13 09:34:28 localhost kernel: Bluetooth: HCI socket layer initialized
Sep 13 09:34:28 localhost kernel: Bluetooth: L2CAP ver 2.8
Sep 13 09:34:28 localhost kernel: Bluetooth: L2CAP socket layer initialized
Sep 13 09:34:28 localhost kernel: Bluetooth: RFCOMM socket layer initialized
Sep 13 09:34:28 localhost kernel: Bluetooth: RFCOMM TTY layer initialized
Sep 13 09:34:28 localhost kernel: Bluetooth: RFCOMM ver 1.8
Sep 13 09:34:29 localhost kernel: Bluetooth: HIDP (Human Interface Emulation) ver 1.1
Sep 13 09:34:31 localhost ntpd[4036]: kernel time sync status 0040
Sep 13 09:34:40 localhost kernel: mtrr: type mismatch for df800000,800000 old: write-back new: write-combining
Sep 13 09:37:48 localhost ntpd[4036]: kernel time sync enabled 0001
Sep 13 17:19:35 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: Call Trace:
Sep 13 17:19:35 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:19:35 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:19:35 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:19:35 localhost kernel: <EOI> [<ffffffff8018321d>] acpi_processor_idle+0x1d6/0x463
Sep 13 17:19:35 localhost kernel: [<ffffffff8018316d>] acpi_processor_idle+0x126/0x463
Sep 13 17:19:35 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 13 17:19:35 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 13 17:19:35 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 13 17:19:35 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: Call Trace:
Sep 13 17:19:35 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:19:35 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:19:35 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:19:35 localhost kernel: <EOI> [<ffffffff800195bd>] current_kernel_time+0x20/0x38
Sep 13 17:19:35 localhost kernel: [<ffffffff800b27ae>] audit_syscall_entry+0x14d/0x180
Sep 13 17:19:35 localhost kernel: [<ffffffff8005b229>] tracesys+0x71/0xe0
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: Call Trace:
Sep 13 17:19:35 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:19:35 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:19:35 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:19:35 localhost kernel: [<ffffffff8000c505>] __delay+0x8/0x10
Sep 13 17:19:35 localhost kernel: [<ffffffff88293ed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 13 17:19:35 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 13 17:19:35 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 13 17:19:35 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 13 17:19:35 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 13 17:19:35 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 13 17:19:35 localhost kernel: [<ffffffff80087d09>] __activate_task+0x27/0x39
Sep 13 17:19:35 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 13 17:19:35 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 13 17:19:35 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 13 17:19:35 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 13 17:19:35 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 13 17:19:35 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 17:19:35 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:19:35 localhost kernel: <EOI> [<ffffffff88293ef2>] :e1000:e1000_get_hw_eeprom_semaphore+0xb5/0xf0
Sep 13 17:19:35 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 13 17:19:35 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 13 17:19:35 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 13 17:19:35 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 13 17:19:35 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 13 17:19:35 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 13 17:19:35 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 13 17:19:35 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 13 17:19:35 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 13 17:19:35 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 13 17:19:35 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 13 17:19:35 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 13 17:19:35 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 13 17:19:35 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 13 17:19:35 localhost kernel:
Sep 13 17:19:35 localhost kernel: Call Trace:
Sep 13 17:19:35 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:19:35 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:19:35 localhost kernel: [<ffffffff8021340b>] dst_run_gc+0x0/0x123
Sep 13 17:19:35 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:19:35 localhost kernel: [<ffffffff800928e1>] run_timer_softirq+0x12a/0x1b0
Sep 13 17:19:35 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 13 17:19:35 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 17:19:35 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:19:35 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 13 17:19:35 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 13 17:19:35 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 13 17:19:35 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 13 17:19:35 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 13 17:19:35 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 13 17:19:35 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 13 17:19:35 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 13 17:19:35 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 13 17:19:35 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 13 17:19:35 localhost kernel:
Sep 13 17:20:07 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 13 17:20:07 localhost kernel:
Sep 13 17:20:07 localhost kernel: Call Trace:
Sep 13 17:20:07 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:20:07 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:20:07 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:20:07 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:20:07 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:20:07 localhost kernel: <EOI>
Sep 13 17:20:07 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 13 17:20:07 localhost kernel:
Sep 13 17:20:07 localhost kernel: Call Trace:
Sep 13 17:20:07 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:20:07 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:20:07 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:20:07 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:20:07 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:20:07 localhost kernel: <EOI>
Sep 13 17:20:07 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 13 17:20:07 localhost kernel:
Sep 13 17:20:07 localhost kernel: Call Trace:
Sep 13 17:20:07 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 17:20:07 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 17:20:07 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 17:20:07 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 17:20:07 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 17:20:07 localhost kernel: <EOI> [<ffffffff8011b808>] avc_has_perm_noaudit+0x33/0x36b
Sep 13 17:20:07 localhost kernel: [<ffffffff8011c6ee>] avc_has_perm+0x26/0x55
Sep 13 17:20:07 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 13 17:20:07 localhost kernel: [<ffffffff80009646>] __link_path_walk+0x15e/0xf42
Sep 13 17:20:07 localhost kernel: [<ffffffff8000e5b9>] link_path_walk+0x5c/0xe5
Sep 13 17:20:07 localhost kernel: [<ffffffff80121966>] selinux_inode_follow_link+0x5f/0x6a
Sep 13 17:20:07 localhost kernel: [<ffffffff80040402>] vfs_follow_link+0x16d/0x1cc
Sep 13 17:20:07 localhost kernel: [<ffffffff800f9680>] proc_self_follow_link+0x35/0x3f
Sep 13 17:20:07 localhost kernel: [<ffffffff800099fa>] __link_path_walk+0x512/0xf42
Sep 13 17:20:07 localhost kernel: [<ffffffff8000e5b9>] link_path_walk+0x5c/0xe5
Sep 13 17:20:07 localhost kernel: [<ffffffff8000b513>] touch_atime+0x67/0xaa
Sep 13 17:20:07 localhost kernel: [<ffffffff8000a1e5>] __link_path_walk+0xcfd/0xf42
Sep 13 17:20:07 localhost kernel: [<ffffffff8000e5b9>] link_path_walk+0x5c/0xe5
Sep 13 17:20:07 localhost kernel: [<ffffffff8000c7e8>] do_path_lookup+0x270/0x2e8
Sep 13 17:20:07 localhost kernel: [<ffffffff800232cf>] __path_lookup_intent_open+0x56/0x97
Sep 13 17:20:07 localhost kernel: [<ffffffff8001a778>] open_namei+0x83/0x6fd
Sep 13 17:20:07 localhost kernel: [<ffffffff800270ce>] do_filp_open+0x1c/0x38
Sep 13 17:20:07 localhost kernel: [<ffffffff80019523>] do_sys_open+0x44/0xbe
Sep 13 17:20:07 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 13 17:20:08 localhost kernel:
Sep 13 21:29:54 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:11 localhost kernel: Call Trace:
Sep 13 21:30:11 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:11 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:11 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:11 localhost kernel: [<ffffffff8000c501>] __delay+0x4/0x10
Sep 13 21:30:11 localhost kernel: [<ffffffff88293ed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 13 21:30:11 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 13 21:30:11 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 13 21:30:11 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 13 21:30:11 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 13 21:30:11 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 13 21:30:11 localhost kernel: [<ffffffff80087d09>] __activate_task+0x27/0x39
Sep 13 21:30:11 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 13 21:30:11 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 13 21:30:11 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 13 21:30:11 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 13 21:30:11 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 13 21:30:11 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 21:30:11 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:11 localhost kernel: <EOI> [<ffffffff88293ef2>] :e1000:e1000_get_hw_eeprom_semaphore+0xb5/0xf0
Sep 13 21:30:11 localhost kernel: [<ffffffff88293f54>] :e1000:e1000_swfw_sync_release+0x27/0x4c
Sep 13 21:30:11 localhost kernel: [<ffffffff88294567>] :e1000:e1000_write_phy_reg+0xd6/0xe3
Sep 13 21:30:11 localhost kernel: [<ffffffff8829667d>] :e1000:e1000_get_speed_and_duplex+0x1c3/0x30d
Sep 13 21:30:11 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 13 21:30:11 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 13 21:30:11 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 13 21:30:11 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 13 21:30:11 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 13 21:30:11 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 13 21:30:11 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 13 21:30:11 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 13 21:30:11 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 13 21:30:11 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 13 21:30:11 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:11 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:11 localhost kernel: Call Trace:
Sep 13 21:30:11 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:11 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:11 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:11 localhost kernel: [<ffffffff80011ca9>] __do_softirq+0x53/0xd5
Sep 13 21:30:11 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 21:30:11 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:11 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 13 21:30:11 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 13 21:30:11 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 13 21:30:11 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 13 21:30:11 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 13 21:30:11 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 13 21:30:11 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 13 21:30:11 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 13 21:30:11 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:11 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:11 localhost kernel: Call Trace:
Sep 13 21:30:11 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:11 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:11 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:11 localhost kernel: <EOI>
Sep 13 21:30:11 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:11 localhost kernel: Call Trace:
Sep 13 21:30:11 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:11 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:11 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:11 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 13 21:30:11 localhost kernel: [<ffffffff8001c40f>] __mod_timer+0xb0/0xbe
Sep 13 21:30:11 localhost kernel: [<ffffffff881c7ee9>] :jbd:start_this_handle+0x1d7/0x37b
Sep 13 21:30:11 localhost kernel: [<ffffffff80032ca3>] submit_bio+0xcd/0xd4
Sep 13 21:30:11 localhost kernel: [<ffffffff881c8156>] :jbd:journal_start+0xc9/0x100
Sep 13 21:30:11 localhost kernel: [<ffffffff881e53a9>] :ext3:ext3_ordered_writepage+0x7d/0x198
Sep 13 21:30:11 localhost kernel: [<ffffffff8001c715>] mpage_writepages+0x1ab/0x34c
Sep 13 21:30:11 localhost kernel: [<ffffffff881e532c>] :ext3:ext3_ordered_writepage+0x0/0x198
Sep 13 21:30:11 localhost kernel: [<ffffffff801405e0>] __next_cpu+0x19/0x28
Sep 13 21:30:11 localhost kernel: [<ffffffff80087044>] find_busiest_group+0x20d/0x621
Sep 13 21:30:11 localhost kernel: [<ffffffff8005903f>] do_writepages+0x29/0x2f
Sep 13 21:30:11 localhost kernel: [<ffffffff8002f8a5>] __writeback_single_inode+0x1a8/0x322
Sep 13 21:30:11 localhost kernel: [<ffffffff8842fc61>] :dm_mod:dm_any_congested+0x38/0x3f
Sep 13 21:30:11 localhost kernel: [<ffffffff884319a0>] :dm_mod:dm_table_any_congested+0x46/0x63
Sep 13 21:30:11 localhost kernel: [<ffffffff80020af0>] sync_sb_inodes+0x1a9/0x267
Sep 13 21:30:11 localhost kernel: [<ffffffff8009b283>] keventd_create_kthread+0x0/0x61
Sep 13 21:30:11 localhost kernel: [<ffffffff8004ecc4>] writeback_inodes+0x82/0xd8
Sep 13 21:30:11 localhost kernel: [<ffffffff800c110a>] wb_kupdate+0x9e/0x10d
Sep 13 21:30:11 localhost kernel: [<ffffffff800544db>] pdflush+0x0/0x1fb
Sep 13 21:30:11 localhost kernel: [<ffffffff8005462c>] pdflush+0x151/0x1fb
Sep 13 21:30:11 localhost kernel: [<ffffffff800c106c>] wb_kupdate+0x0/0x10d
Sep 13 21:30:11 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 13 21:30:11 localhost kernel: [<ffffffff8009b283>] keventd_create_kthread+0x0/0x61
Sep 13 21:30:11 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 13 21:30:11 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 13 21:30:11 localhost kernel:
Sep 13 21:30:42 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 13 21:30:42 localhost kernel:
Sep 13 21:30:42 localhost kernel: Call Trace:
Sep 13 21:30:42 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:42 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:42 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:42 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:42 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:42 localhost kernel: [<ffffffff80011ca9>] __do_softirq+0x53/0xd5
Sep 13 21:30:42 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 13 21:30:42 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 13 21:30:42 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:42 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 13 21:30:42 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 13 21:30:42 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 13 21:30:42 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 13 21:30:42 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 13 21:30:42 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 13 21:30:42 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 13 21:30:42 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 13 21:30:42 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 13 21:30:42 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 13 21:30:42 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 13 21:30:43 localhost kernel:
Sep 13 21:30:43 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 13 21:30:43 localhost kernel:
Sep 13 21:30:43 localhost kernel: Call Trace:
Sep 13 21:30:43 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:43 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:43 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:43 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:43 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:43 localhost kernel: <EOI>
Sep 13 21:30:43 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 13 21:30:43 localhost kernel:
Sep 13 21:30:43 localhost kernel: Call Trace:
Sep 13 21:30:43 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:43 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:43 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:43 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:43 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:43 localhost kernel: <EOI>
Sep 13 21:30:43 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 13 21:30:43 localhost kernel:
Sep 13 21:30:43 localhost kernel: Call Trace:
Sep 13 21:30:43 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 13 21:30:43 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 13 21:30:43 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 13 21:30:43 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 13 21:30:43 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 13 21:30:43 localhost kernel: <EOI>
Sep 15 21:19:20 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: Call Trace:
Sep 15 21:19:20 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:20 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:20 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:20 localhost kernel: [<ffffffff8000c503>] __delay+0x6/0x10
Sep 15 21:19:20 localhost kernel: [<ffffffff88293ed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 15 21:19:20 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 15 21:19:20 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 15 21:19:20 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 15 21:19:20 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 15 21:19:20 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 15 21:19:20 localhost kernel: [<ffffffff80087d09>] __activate_task+0x27/0x39
Sep 15 21:19:20 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 15 21:19:20 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 15 21:19:20 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 15 21:19:20 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 15 21:19:20 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 15 21:19:20 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 15 21:19:20 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:20 localhost kernel: <EOI> [<ffffffff88293f66>] :e1000:e1000_swfw_sync_release+0x39/0x4c
Sep 15 21:19:20 localhost kernel: [<ffffffff88293f54>] :e1000:e1000_swfw_sync_release+0x27/0x4c
Sep 15 21:19:20 localhost kernel: [<ffffffff88294772>] :e1000:e1000_read_phy_reg+0x1fe/0x212
Sep 15 21:19:20 localhost kernel: [<ffffffff882965e6>] :e1000:e1000_get_speed_and_duplex+0x12c/0x30d
Sep 15 21:19:20 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 15 21:19:20 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 15 21:19:20 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 15 21:19:20 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 15 21:19:20 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 15 21:19:20 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 15 21:19:20 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 15 21:19:20 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 15 21:19:20 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 15 21:19:20 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 15 21:19:20 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: Call Trace:
Sep 15 21:19:20 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:20 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:20 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:20 localhost kernel: <EOI> [<ffffffff80054f26>] mwait_idle+0x36/0x4a
Sep 15 21:19:20 localhost kernel: [<ffffffff801831ed>] acpi_processor_idle+0x1a6/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 15 21:19:20 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: Call Trace:
Sep 15 21:19:20 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:20 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:20 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:20 localhost kernel: [<ffffffff80011ca9>] __do_softirq+0x53/0xd5
Sep 15 21:19:20 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 15 21:19:20 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:20 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 15 21:19:20 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 15 21:19:20 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 15 21:19:20 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 15 21:19:20 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 15 21:19:20 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 15 21:19:20 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 15 21:19:20 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 15 21:19:20 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:20 localhost kernel: Call Trace:
Sep 15 21:19:20 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:20 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:20 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:20 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:20 localhost kernel: <EOI> [<ffffffff80054f26>] mwait_idle+0x36/0x4a
Sep 15 21:19:20 localhost kernel: [<ffffffff801831ed>] acpi_processor_idle+0x1a6/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 15 21:19:20 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 15 21:19:20 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 15 21:19:20 localhost kernel:
Sep 15 21:19:53 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 15 21:19:53 localhost kernel:
Sep 15 21:19:53 localhost kernel: Call Trace:
Sep 15 21:19:53 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:53 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:53 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:53 localhost kernel: <EOI> [<ffffffff800093e9>] __d_lookup+0x0/0xff
Sep 15 21:19:53 localhost kernel: [<ffffffff8003a61a>] d_lookup+0x1e/0x42
Sep 15 21:19:53 localhost kernel: [<ffffffff8000c9fa>] do_lookup+0x96/0x1c3
Sep 15 21:19:53 localhost kernel: [<ffffffff8000988e>] __link_path_walk+0x3a6/0xf42
Sep 15 21:19:53 localhost kernel: [<ffffffff8000e5b9>] link_path_walk+0x5c/0xe5
Sep 15 21:19:53 localhost kernel: [<ffffffff8000c7e8>] do_path_lookup+0x270/0x2e8
Sep 15 21:19:53 localhost kernel: [<ffffffff800232cf>] __path_lookup_intent_open+0x56/0x97
Sep 15 21:19:53 localhost kernel: [<ffffffff8001a778>] open_namei+0x83/0x6fd
Sep 15 21:19:53 localhost kernel: [<ffffffff800270ce>] do_filp_open+0x1c/0x38
Sep 15 21:19:53 localhost kernel: [<ffffffff80019523>] do_sys_open+0x44/0xbe
Sep 15 21:19:53 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 15 21:19:53 localhost kernel:
Sep 15 21:19:53 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 15 21:19:53 localhost kernel:
Sep 15 21:19:53 localhost kernel: Call Trace:
Sep 15 21:19:53 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:53 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:53 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:53 localhost kernel: <EOI> [<ffffffff800b266d>] audit_syscall_entry+0xc/0x180
Sep 15 21:19:53 localhost kernel: [<ffffffff8005b229>] tracesys+0x71/0xe0
Sep 15 21:19:53 localhost kernel:
Sep 15 21:19:53 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 15 21:19:53 localhost kernel:
Sep 15 21:19:53 localhost kernel: Call Trace:
Sep 15 21:19:53 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:53 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:53 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:53 localhost kernel: <EOI>
Sep 15 21:19:53 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 15 21:19:53 localhost kernel:
Sep 15 21:19:53 localhost kernel: Call Trace:
Sep 15 21:19:53 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 15 21:19:53 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 15 21:19:53 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 15 21:19:53 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 15 21:19:53 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 15 21:19:53 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 15 21:19:53 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 15 21:19:53 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 15 21:19:53 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 15 21:19:53 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 15 21:19:53 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 15 21:19:53 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 15 21:19:53 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 15 21:19:53 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 15 21:19:53 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 15 21:19:53 localhost kernel:
Sep 16 14:35:50 localhost ntpd[19521]: kernel time sync status 0040
Sep 16 14:39:06 localhost ntpd[19521]: kernel time sync enabled 0001
Sep 23 19:25:40 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: Call Trace:
Sep 23 19:25:40 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:25:40 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:25:40 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:25:40 localhost kernel: [<ffffffff8000c505>] __delay+0x8/0x10
Sep 23 19:25:40 localhost kernel: [<ffffffff88293ed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 23 19:25:40 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 23 19:25:40 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 23 19:25:40 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 23 19:25:40 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 23 19:25:40 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 23 19:25:40 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 23 19:25:40 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 23 19:25:40 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 23 19:25:40 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 23 19:25:40 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 23 19:25:40 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 23 19:25:40 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:25:40 localhost kernel: <EOI> [<ffffffff88294297>] :e1000:e1000_swfw_sync_acquire+0x62/0x10e
Sep 23 19:25:40 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 23 19:25:40 localhost kernel: [<ffffffff882945b4>] :e1000:e1000_read_phy_reg+0x40/0x212
Sep 23 19:25:40 localhost kernel: [<ffffffff882965e6>] :e1000:e1000_get_speed_and_duplex+0x12c/0x30d
Sep 23 19:25:40 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 23 19:25:40 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 23 19:25:40 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 23 19:25:40 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 23 19:25:40 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 23 19:25:40 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 23 19:25:40 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 23 19:25:40 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 23 19:25:40 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 23 19:25:40 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 23 19:25:40 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: Call Trace:
Sep 23 19:25:40 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:25:40 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:25:40 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:25:40 localhost kernel: [<ffffffff80011ca9>] __do_softirq+0x53/0xd5
Sep 23 19:25:40 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 23 19:25:40 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:25:40 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 23 19:25:40 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 23 19:25:40 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 23 19:25:40 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 23 19:25:40 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 23 19:25:40 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 23 19:25:40 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 23 19:25:40 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 23 19:25:40 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: Call Trace:
Sep 23 19:25:40 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:25:40 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:25:40 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:25:40 localhost kernel: <EOI> [<ffffffff80054f26>] mwait_idle+0x36/0x4a
Sep 23 19:25:40 localhost kernel: [<ffffffff801831ed>] acpi_processor_idle+0x1a6/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 23 19:25:40 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 23 19:25:40 localhost kernel:
Sep 23 19:25:40 localhost kernel: Call Trace:
Sep 23 19:25:40 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:25:40 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:25:40 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:25:40 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:25:40 localhost kernel: [<ffffffff80010792>] handle_IRQ_event+0x1b/0x58
Sep 23 19:25:40 localhost kernel: [<ffffffff800b5482>] __do_IRQ+0xa4/0x105
Sep 23 19:25:40 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 23 19:25:40 localhost kernel: [<ffffffff8006a3bd>] do_IRQ+0xe7/0xf5
Sep 23 19:25:40 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff8005b615>] ret_from_intr+0x0/0xa
Sep 23 19:25:40 localhost kernel: <EOI> [<ffffffff80054f26>] mwait_idle+0x36/0x4a
Sep 23 19:25:40 localhost kernel: [<ffffffff801831ed>] acpi_processor_idle+0x1a6/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff8006041a>] __sched_text_start+0xa/0xb19
Sep 23 19:25:40 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:25:40 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 23 19:25:40 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 23 19:25:40 localhost kernel:
Sep 23 19:26:11 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 23 19:26:11 localhost kernel:
Sep 23 19:26:11 localhost kernel: Call Trace:
Sep 23 19:26:11 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:26:11 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:26:11 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:26:11 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:26:11 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:26:11 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:26:11 localhost kernel: <EOI> [<ffffffff80054f26>] mwait_idle+0x36/0x4a
Sep 23 19:26:11 localhost kernel: [<ffffffff801831ed>] acpi_processor_idle+0x1a6/0x463
Sep 23 19:26:11 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:26:11 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 23 19:26:11 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 23 19:26:11 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 23 19:26:11 localhost kernel:
Sep 23 19:26:11 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 23 19:26:11 localhost kernel:
Sep 23 19:26:11 localhost kernel: Call Trace:
Sep 23 19:26:11 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:26:11 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:26:11 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:26:12 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:26:12 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:26:12 localhost kernel: <EOI>
Sep 23 19:26:12 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 23 19:26:12 localhost kernel:
Sep 23 19:26:12 localhost kernel: Call Trace:
Sep 23 19:26:12 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:26:12 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:26:12 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:26:12 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:26:12 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:26:12 localhost kernel: <EOI> [<ffffffff8006d857>] arch_get_unmapped_area+0x0/0x1ee
Sep 23 19:26:12 localhost kernel: [<ffffffff8000b79e>] find_vma+0x2f/0x5d
Sep 23 19:26:12 localhost kernel: [<ffffffff8006d9d2>] arch_get_unmapped_area+0x17b/0x1ee
Sep 23 19:26:12 localhost kernel: [<ffffffff800c5b31>] get_unmapped_area_prot+0x83/0x122
Sep 23 19:26:12 localhost kernel: [<ffffffff8000d75e>] do_mmap_pgoff+0x176/0x7a5
Sep 23 19:26:12 localhost kernel: [<ffffffff800b27ae>] audit_syscall_entry+0x14d/0x180
Sep 23 19:26:12 localhost kernel: [<ffffffff80062526>] __down_write_nested+0x12/0x92
Sep 23 19:26:12 localhost kernel: [<ffffffff800235ff>] sys_mmap+0x89/0xc1
Sep 23 19:26:12 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 23 19:26:12 localhost kernel:
Sep 23 19:26:12 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 23 19:26:12 localhost kernel:
Sep 23 19:26:12 localhost kernel: Call Trace:
Sep 23 19:26:12 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 23 19:26:12 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 23 19:26:12 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 23 19:26:12 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 23 19:26:12 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 23 19:26:12 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 23 19:26:12 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 23 19:26:12 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 23 19:26:12 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 23 19:26:12 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 23 19:26:12 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 23 19:26:12 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 23 19:26:12 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 23 19:26:12 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 23 19:26:12 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 23 19:26:12 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 23 19:26:12 localhost kernel:
Sep 26 17:00:37 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 26 17:00:50 localhost kernel:
Sep 26 17:00:50 localhost kernel: Call Trace:
Sep 26 17:00:50 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:00:50 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:00:50 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:00:50 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:00:50 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 26 17:00:50 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:00:50 localhost kernel: <EOI> [<ffffffff80054f26>] mwait_idle+0x36/0x4a
Sep 26 17:00:50 localhost kernel: [<ffffffff801831ed>] acpi_processor_idle+0x1a6/0x463
Sep 26 17:00:50 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 26 17:00:50 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 26 17:01:22 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 26 17:01:22 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: Call Trace:
Sep 26 17:01:22 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:01:22 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:01:22 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: <EOI> [<ffffffff800195bd>] current_kernel_time+0x20/0x38
Sep 26 17:01:22 localhost kernel: [<ffffffff800b27ae>] audit_syscall_entry+0x14d/0x180
Sep 26 17:01:22 localhost kernel: [<ffffffff8005b229>] tracesys+0x71/0xe0
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: Call Trace:
Sep 26 17:01:22 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:01:22 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:01:22 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: [<ffffffff8000c505>] __delay+0x8/0x10
Sep 26 17:01:22 localhost kernel: [<ffffffff88293ed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 26 17:01:22 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 26 17:01:22 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 26 17:01:22 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 26 17:01:22 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 26 17:01:22 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 26 17:01:22 localhost kernel: [<ffffffff80087d09>] __activate_task+0x27/0x39
Sep 26 17:01:22 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 26 17:01:22 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 26 17:01:22 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 26 17:01:22 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 26 17:01:22 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 26 17:01:22 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 26 17:01:22 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: <EOI> [<ffffffff88293440>] :e1000:e1000_put_hw_eeprom_semaphore+0x13/0x2b
Sep 26 17:01:22 localhost kernel: [<ffffffff88294331>] :e1000:e1000_swfw_sync_acquire+0xfc/0x10e
Sep 26 17:01:22 localhost kernel: [<ffffffff882944cb>] :e1000:e1000_write_phy_reg+0x3a/0xe3
Sep 26 17:01:22 localhost kernel: [<ffffffff8829667d>] :e1000:e1000_get_speed_and_duplex+0x1c3/0x30d
Sep 26 17:01:22 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 26 17:01:22 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 26 17:01:22 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 26 17:01:22 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 26 17:01:22 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 26 17:01:22 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 26 17:01:22 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 26 17:01:22 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 26 17:01:22 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 26 17:01:22 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 26 17:01:22 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: Call Trace:
Sep 26 17:01:22 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:01:22 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:01:22 localhost kernel: [<ffffffff80092ada>] process_timeout+0x0/0x5
Sep 26 17:01:22 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: [<ffffffff80092961>] run_timer_softirq+0x1aa/0x1b0
Sep 26 17:01:22 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 26 17:01:22 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 26 17:01:22 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 26 17:01:22 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 26 17:01:22 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 26 17:01:22 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 26 17:01:22 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 26 17:01:22 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 26 17:01:22 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 26 17:01:22 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 26 17:01:22 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: Call Trace:
Sep 26 17:01:22 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:01:22 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:01:22 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: <EOI> [<ffffffff800195bb>] current_kernel_time+0x1e/0x38
Sep 26 17:01:22 localhost kernel: [<ffffffff800b27ae>] audit_syscall_entry+0x14d/0x180
Sep 26 17:01:22 localhost kernel: [<ffffffff8005b229>] tracesys+0x71/0xe0
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: Call Trace:
Sep 26 17:01:22 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:01:22 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:01:22 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: <EOI>
Sep 26 17:01:22 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 26 17:01:22 localhost kernel:
Sep 26 17:01:22 localhost kernel: Call Trace:
Sep 26 17:01:22 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 26 17:01:22 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 26 17:01:22 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 26 17:01:22 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 26 17:01:22 localhost kernel: <EOI>
Sep 27 09:23:57 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 27 09:23:57 localhost kernel:
Sep 27 09:23:57 localhost kernel: Call Trace:
Sep 27 09:23:57 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:23:57 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:23:57 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:23:57 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:23:57 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 27 09:23:57 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:23:57 localhost kernel: <EOI> [<ffffffff8018321d>] acpi_processor_idle+0x1d6/0x463
Sep 27 09:23:57 localhost kernel: [<ffffffff8018316d>] acpi_processor_idle+0x126/0x463
Sep 27 09:23:57 localhost kernel: [<ffffffff80064dde>] notifier_call_chain+0xf/0x32
Sep 27 09:23:57 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 27 09:23:57 localhost kernel: [<ffffffff80183047>] acpi_processor_idle+0x0/0x463
Sep 27 09:23:57 localhost kernel: [<ffffffff80046f8d>] cpu_idle+0x95/0xb8
Sep 27 09:23:57 localhost kernel: [<ffffffff80074501>] start_secondary+0x45a/0x469
Sep 27 09:23:57 localhost kernel:
Sep 27 09:23:57 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 27 09:23:57 localhost kernel:
Sep 27 09:23:57 localhost kernel: Call Trace:
Sep 27 09:23:57 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:23:57 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:23:57 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:23:57 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:23:57 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:23:57 localhost kernel: <EOI>
Sep 27 09:23:57 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 27 09:23:57 localhost kernel:
Sep 27 09:23:57 localhost kernel: Call Trace:
Sep 27 09:23:57 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:23:57 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:23:57 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:23:57 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:23:57 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:23:57 localhost kernel: [<ffffffff8000c505>] __delay+0x8/0x10
Sep 27 09:23:57 localhost kernel: [<ffffffff88293ed4>] :e1000:e1000_get_hw_eeprom_semaphore+0x97/0xf0
Sep 27 09:23:57 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 27 09:23:57 localhost kernel: [<ffffffff88294450>] :e1000:e1000_write_kmrn_reg+0x3b/0x7c
Sep 27 09:23:57 localhost kernel: [<ffffffff882965b3>] :e1000:e1000_get_speed_and_duplex+0xf9/0x30d
Sep 27 09:23:57 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 27 09:23:57 localhost kernel: [<ffffffff88512074>] :bonding:bond_update_speed_duplex+0x3a/0x109
Sep 27 09:23:57 localhost kernel: [<ffffffff80087d09>] __activate_task+0x27/0x39
Sep 27 09:23:57 localhost kernel: [<ffffffff80044cf9>] try_to_wake_up+0x407/0x418
Sep 27 09:23:57 localhost kernel: [<ffffffff88514fa9>] :bonding:bond_mii_monitor+0x368/0x403
Sep 27 09:23:57 localhost kernel: [<ffffffff88514c41>] :bonding:bond_mii_monitor+0x0/0x403
Sep 27 09:23:57 localhost kernel: [<ffffffff800928ea>] run_timer_softirq+0x133/0x1b0
Sep 27 09:23:57 localhost kernel: [<ffffffff80011cb4>] __do_softirq+0x5e/0xd5
Sep 27 09:23:57 localhost kernel: [<ffffffff8005c2fc>] call_softirq+0x1c/0x28
Sep 27 09:23:57 localhost kernel: [<ffffffff8006a53a>] do_softirq+0x2c/0x85
Sep 27 09:23:57 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:23:57 localhost kernel: <EOI> [<ffffffff88294297>] :e1000:e1000_swfw_sync_acquire+0x62/0x10e
Sep 27 09:23:57 localhost kernel: [<ffffffff8829427f>] :e1000:e1000_swfw_sync_acquire+0x4a/0x10e
Sep 27 09:23:57 localhost kernel: [<ffffffff882944cb>] :e1000:e1000_write_phy_reg+0x3a/0xe3
Sep 27 09:23:57 localhost kernel: [<ffffffff8829667d>] :e1000:e1000_get_speed_and_duplex+0x1c3/0x30d
Sep 27 09:23:57 localhost kernel: [<ffffffff8829b0fc>] :e1000:e1000_get_settings+0xaa/0xf1
Sep 27 09:23:57 localhost kernel: [<ffffffff8021217b>] dev_ethtool+0xf5/0xcd7
Sep 27 09:23:57 localhost kernel: [<ffffffff8011c70b>] avc_has_perm+0x43/0x55
Sep 27 09:23:57 localhost kernel: [<ffffffff80211662>] dev_ioctl+0x302/0x465
Sep 27 09:23:57 localhost kernel: [<ffffffff8011d242>] inode_has_perm+0x56/0x63
Sep 27 09:23:57 localhost kernel: [<ffffffff80032f05>] lock_sock+0xa7/0xb2
Sep 27 09:23:57 localhost kernel: [<ffffffff80208a5b>] sock_ioctl+0x1d4/0x1e5
Sep 27 09:23:57 localhost kernel: [<ffffffff8003fc22>] do_ioctl+0x21/0x6b
Sep 27 09:23:57 localhost kernel: [<ffffffff8002fc67>] vfs_ioctl+0x248/0x261
Sep 27 09:23:57 localhost kernel: [<ffffffff8004a242>] sys_ioctl+0x59/0x78
Sep 27 09:23:57 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 27 09:23:57 localhost kernel:
Sep 27 09:23:57 localhost kernel: BUG: soft lockup detected on CPU#0!
Sep 27 09:23:57 localhost kernel:
Sep 27 09:24:28 localhost kernel: Call Trace:
Sep 27 09:24:28 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:24:28 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:24:28 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:24:28 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:24:28 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:24:28 localhost kernel: <EOI> [<ffffffff80062ad0>] _spin_unlock_irqrestore+0x8/0x9
Sep 27 09:24:28 localhost kernel: [<ffffffff8828cc99>] :e1000:e1000_update_stats+0x62e/0x635
Sep 27 09:24:28 localhost kernel: [<ffffffff88290f14>] :e1000:e1000_watchdog_task+0x535/0x65a
Sep 27 09:24:28 localhost kernel: [<ffffffff8004b2ab>] run_workqueue+0x94/0xe5
Sep 27 09:24:29 localhost kernel: [<ffffffff80047c09>] worker_thread+0x0/0x122
Sep 27 09:24:29 localhost kernel: [<ffffffff80047cf9>] worker_thread+0xf0/0x122
Sep 27 09:24:29 localhost kernel: [<ffffffff800884ac>] default_wake_function+0x0/0xe
Sep 27 09:24:29 localhost kernel: [<ffffffff800321d8>] kthread+0xfe/0x132
Sep 27 09:24:29 localhost kernel: [<ffffffff8005bfb1>] child_rip+0xa/0x11
Sep 27 09:24:29 localhost kernel: [<ffffffff800320da>] kthread+0x0/0x132
Sep 27 09:24:29 localhost kernel: [<ffffffff8005bfa7>] child_rip+0x0/0x11
Sep 27 09:24:29 localhost kernel:
Sep 27 09:24:29 localhost kernel: BUG: soft lockup detected on CPU#2!
Sep 27 09:24:29 localhost kernel:
Sep 27 09:24:29 localhost kernel: Call Trace:
Sep 27 09:24:29 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:24:29 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:24:29 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:24:29 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:24:29 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:24:29 localhost kernel: <EOI>
Sep 27 09:24:29 localhost kernel: BUG: soft lockup detected on CPU#3!
Sep 27 09:24:29 localhost kernel:
Sep 27 09:24:29 localhost kernel: Call Trace:
Sep 27 09:24:29 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:24:29 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:24:29 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:24:29 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:24:29 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:24:29 localhost kernel: <EOI> [<ffffffff800135e4>] generic_file_llseek+0x0/0x8b
Sep 27 09:24:29 localhost kernel: [<ffffffff8002e463>] vfs_llseek+0x21/0x35
Sep 27 09:24:29 localhost kernel: [<ffffffff800251cb>] sys_lseek+0x40/0x60
Sep 27 09:24:29 localhost kernel: [<ffffffff8005b229>] tracesys+0x71/0xe0
Sep 27 09:24:29 localhost kernel: [<ffffffff8005b28d>] tracesys+0xd5/0xe0
Sep 27 09:24:29 localhost kernel:
Sep 27 09:24:29 localhost kernel: BUG: soft lockup detected on CPU#1!
Sep 27 09:24:29 localhost kernel:
Sep 27 09:24:29 localhost kernel: Call Trace:
Sep 27 09:24:29 localhost kernel: <IRQ> [<ffffffff800b50fa>] softlockup_tick+0xd5/0xe7
Sep 27 09:24:29 localhost kernel: [<ffffffff800930e2>] update_process_times+0x42/0x68
Sep 27 09:24:29 localhost kernel: [<ffffffff800746e3>] smp_local_timer_interrupt+0x23/0x47
Sep 27 09:24:29 localhost kernel: [<ffffffff80074da5>] smp_apic_timer_interrupt+0x41/0x47
Sep 27 09:24:29 localhost kernel: [<ffffffff8005bc8e>] apic_timer_interrupt+0x66/0x6c
Sep 27 09:24:29 localhost kernel: <EOI>
ASKER CERTIFIED SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
SOLUTION
membership
This solution is only available to members.
To access this solution, you must be a member of Experts Exchange.
ASKER
Thanks for your suggestion.
Regards,
Anurat