Startin[1030433.672868] NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [atop:21595] [1030433.681216] Modules linked in: binfmt_misc 8021q garp mrp stp llc iptable_raw nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables xt_CT ip6table_raw xt_tcpudp xt_pkttype nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables intel_rapl sb_edac edac_core x86_pkg_temp_thermal intel_powerclamp coretemp kvm mgag200 ttm drm_kms_helper irqbypass iTCO_wdt evdev pcspkr drm crct10dif_pclmul crc32_pclmul dcdbas iTCO_vendor_support ghash_clmulni_intel mxm_wmi i2c_algo_bit intel_cstate intel_rapl_perf mei_me mei shpchp lpc_ich mfd_core button ipmi_si wmi ipmi_devintf ipmi_msghandler nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache raid1 md_mod sg sd_mod crc32c_intel ahci tg3 aesni_intel libahci aes_x86_64 ptp glue_helper lrw ehci_pci gf128mul ablk_helper ehci_hcd pps_core cryptd libata libphy usbcore scsi_mod usb_common [1030433.765768] CPU: 14 PID: 21595 Comm: atop Tainted: G D L 4.9.0-0.bpo.3-amd64 #1 Debian 4.9.25-1~bpo8+3 [1030433.777413] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.3.4 11/08/2016 [1030433.785955] task: ffff969a59da7000 task.stack: ffffa6d946f90000 [1030433.792752] RIP: 0010:[] [] native_queued_spin_lock_slowpath+0x16f/0x190 [1030433.804019] RSP: 0018:ffffa6d946f93c88 EFLAGS: 00000202 [1030433.810139] RAX: 0000000000000101 RBX: ffff9692563a07b8 RCX: 0000000000000101 [1030433.818293] RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff9692569d1718 [1030433.826448] RBP: ffff9692569d1000 R08: 0000000000000001 R09: 0000000000000004 [1030433.834603] R10: ffffffffffffffff R11: ffff96925639eb78 R12: ffff9692569d1718 [1030433.842758] R13: ffffa6d946f93d80 R14: ffff969258297b60 R15: 00000000fffffff6 [1030433.850914] FS: 00007f74648c5700(0000) GS:ffff96925f9c0000(0000) knlGS:0000000000000000 [1030433.860135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [1030433.866737] CR2: 00007fd80dc43ff8 CR3: 000000085b46b000 CR4: 00000000003406e0 [1030433.874891] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1030433.883045] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [1030433.891201] Stack: [1030433.893634] ffffffffb1c053cd ffffffffb1874e5a ffffa6d946f93df0 ffff96925639eb40 [1030433.902115] ffffa6d946f93d88 ffffffffb180e442 ffffa6d9004800cc ffffa6d946f93d7c [1030433.910595] 0000000246f93f04 0000000029848ad4 ffff969256188b40 0000000000008000 [1030433.919076] Call Trace: [1030433.921996] [] ? _raw_spin_lock+0x1d/0x20 [1030433.928505] [] ? pid_revalidate+0x4a/0xe0 [1030433.935012] [] ? lookup_fast+0x2a2/0x300 [1030433.941424] [] ? path_openat+0x180/0x1510 [1030433.947932] [] ? dput+0x2f/0x240 [1030433.953567] [] ? walk_component+0xea/0x440 [1030433.960170] [] ? do_filp_open+0x91/0x100 [1030433.966581] [] ? __check_object_size+0x10b/0x1dc [1030433.973766] [] ? do_sys_open+0x127/0x210 [1030433.980176] [] ? system_call_fast_compare_end+0xc/0x9b [1030433.987942] Code: c2 89 d0 66 31 c0 41 39 c0 74 e6 4d 85 c9 c6 07 01 74 2d 41 c7 41 08 01 00 00 00 e9 52 ff ff ff 83 fa 01 74 17 8b 07 84 c0 74 08 90 8b 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 f3 c3 f3 90 [1030440.068717] INFO: rcu_sched detected stalls on CPUs/tasks: [1030440.075045] 0-...: (1 GPs behind) idle=165/1/0 softirq=25367170/25367170 fqs=3290 [1030440.083785] 4-...: (0 ticks this GP) idle=ea7/140000000000000/0 softirq=6816005/6816005 fqs=3290 [1030440.093979] 12-...: (6 GPs behind) idle=32f/1/0 softirq=2929704/2929704 fqs=3290 [1030440.102621] (detected by 24, t=9836380 jiffies, g=18962974, c=18962973, q=17449) [1030440.111177] Task dump for CPU 0: [1030440.114970] swapper/0 R running task 0 0 0 0x00000000 [1030440.123049] 00000000000000f6 0000000000000003 ffff96925f8187c0 000000000000001f [1030440.131538] 0000000000000000 ffff96925f815f18 0000000000000000 ffffffffffffff9d [1030440.140026] ffffffffb1acb333 0000000000000010 0000000000000246 ffffffffb2203ed0 [1030440.148515] Call Trace: [1030440.151438] [] ? cpuidle_enter_state+0x113/0x260 [1030440.158626] [] ? cpu_startup_entry+0x17e/0x260 [1030440.165622] [] ? start_kernel+0x46d/0x48d [1030440.172132] [] ? early_idt_handler_array+0x120/0x120 [1030440.179709] [] ? x86_64_start_kernel+0x152/0x176 [1030440.186895] Task dump for CPU 4: [1030440.190687] md1_raid1 R running task 0 548 2 0x00000008 [1030440.198766] ffffffffc0393f07 ffff9692569d1000 ffff96925c3f1080 0000000000000001 [1030440.207254] ffffa6d94793bdd0 ffff969258b7ec38 ffff9692515aba00 ffff969258b7ec00 [1030440.215742] ffff969258074000 ffff969200000004 0000000000000000 ffff969258b7ec00 [1030440.224228] Call Trace: [1030440.227150] [] ? raid1d+0x7f7/0x1050 [raid1] [1030440.233953] [] ? lock_timer_base+0x90/0x90 [1030440.240551] [] ? _raw_spin_lock_irqsave+0x32/0x40 [1030440.247837] [] ? complete+0x18/0x40 [1030440.253767] [] ? mm_release+0xb0/0x130 [1030440.259985] [] ? do_exit+0x14b/0xb50 [1030440.266010] [] ? rewind_stack_do_exit+0x17/0x20 [1030440.273101] Task dump for CPU 12: [1030440.276991] swapper/12 R running task 0 0 1 0x00000008 [1030440.285067] 000000000024c6a2 0000000000000004 ffff96925f9987c0 000000000000001f [1030440.293556] 0000000000000000 ffff96925f995f18 0000000000000000 ffffffffffffff10 [1030440.302045] ffffffffb1acb333 0000000000000010 0000000000000246 ffffa6d94645bea0 [1030440.310533] Call Trace: [1030440.313455] [] ? cpuidle_enter_state+0x113/0x260 [1030440.320644] [] ? cpu_startup_entry+0x17e/0x260 [1030440.327638] [] ? start_secondary+0x14d/0x190 [1030440.334438] rcu_sched kthread starved for 9829751 jiffies! g18962974 c18962973 f0x2 RCU_GP_WAIT_FQS(3) ->state=0x0 [1030440.346183] rcu_sched R running task 0 8 2 0x00000000 [1030440.354259] ffff969258ee1400 0000000000000000 ffff96925bc00140 ffff96925c3df080 [1030440.362745] ffff96925f9587c0 ffffa6d94018fdb0 ffffffffb1c0089d ffffa6d94018fde0 [1030440.371234] ffffa6d94018fde0 000000005f950080 0000000000000246 ffff96925c3df080 [1030440.379721] Call Trace: [1030440.382643] [] ? __schedule+0x23d/0x6d0 [1030440.388959] [] ? schedule+0x32/0x80 [1030440.394886] [] ? schedule_timeout+0x17a/0x300 [1030440.401783] [] ? lock_timer_base+0x90/0x90 [1030440.408388] [] ? prepare_to_swait+0x53/0x60 [1030440.415091] [] ? rcu_gp_kthread+0x3db/0x830 [1030440.421795] [] ? __wake_up_common+0x4e/0x90 [1030440.428498] [] ? force_qs_rnp+0x180/0x180 [1030440.435007] [] ? kthread+0xf0/0x110 [1030440.440935] [] ? __switch_to+0x2bb/0x700 [1030440.447347] [] ? kthread_park+0x60/0x60 [1030440.453661] [] ? ret_from_fork+0x25/0x30 [1030461.672203] NMI watchdog: BUG: soft lockup - CPU#14 stuck for 23s! [atop:21595] [1030461.680551] Modules linked in: binfmt_misc 8021q garp mrp stp llc iptable_raw nf_conntrack_ipv4 nf_defrag_ipv4 iptable_filter ip_tables xt_CT ip6table_raw xt_tcpudp xt_pkttype nf_conntrack_ipv6 nf_defrag_ipv6 xt_conntrack ip6table_filter ip6_tables x_tables intel_rapl sb_edac edac_core x86_pkg_temp_thermal intel_powerclamp coretemp kvm mgag200 ttm drm_kms_helper irqbypass iTCO_wdt evdev pcspkr drm crct10dif_pclmul crc32_pclmul dcdbas iTCO_vendor_support ghash_clmulni_intel mxm_wmi i2c_algo_bit intel_cstate intel_rapl_perf mei_me mei shpchp lpc_ich mfd_core button ipmi_si wmi ipmi_devintf ipmi_msghandler nf_conntrack autofs4 ext4 crc16 jbd2 fscrypto mbcache raid1 md_mod sg sd_mod crc32c_intel ahci tg3 aesni_intel libahci aes_x86_64 ptp glue_helper lrw ehci_pci gf128mul ablk_helper ehci_hcd pps_core cryptd libata libphy usbcore scsi_mod usb_common [1030461.765107] CPU: 14 PID: 21595 Comm: atop Tainted: G D L 4.9.0-0.bpo.3-amd64 #1 Debian 4.9.25-1~bpo8+3 [1030461.776752] Hardware name: Dell Inc. PowerEdge R430/0CN7X8, BIOS 2.3.4 11/08/2016 [1030461.785295] task: ffff969a59da7000 task.stack: ffffa6d946f90000 [1030461.792091] RIP: 0010:[] [] native_queued_spin_lock_slowpath+0x171/0x190 [1030461.803359] RSP: 0018:ffffa6d946f93c88 EFLAGS: 00000202 [1030461.809477] RAX: 0000000000000101 RBX: ffff9692563a07b8 RCX: 0000000000000101 [1030461.817631] RDX: 0000000000000101 RSI: 0000000000000001 RDI: ffff9692569d1718 [1030461.825785] RBP: ffff9692569d1000 R08: 0000000000000001 R09: 0000000000000004 [1030461.833940] R10: ffffffffffffffff R11: ffff96925639eb78 R12: ffff9692569d1718 [1030461.842095] R13: ffffa6d946f93d80 R14: ffff969258297b60 R15: 00000000fffffff6 [1030461.850251] FS: 00007f74648c5700(0000) GS:ffff96925f9c0000(0000) knlGS:0000000000000000 [1030461.859471] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 [1030461.866076] CR2: 00007fd80dc43ff8 CR3: 000000085b46b000 CR4: 00000000003406e0 [1030461.874231] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [1030461.882385] DR3: 0000000000000000 DR6: 00000000fffe0ff0 DR7: 0000000000000400 [1030461.890540] Stack: [1030461.892973] ffffffffb1c053cd ffffffffb1874e5a ffffa6d946f93df0 ffff96925639eb40 [1030461.901454] ffffa6d946f93d88 ffffffffb180e442 ffffa6d9004800cc ffffa6d946f93d7c [1030461.909937] 0000000246f93f04 0000000029848ad4 ffff969256188b40 0000000000008000 [1030461.918417] Call Trace: [1030461.921338] [] ? _raw_spin_lock+0x1d/0x20 [1030461.927845] [] ? pid_revalidate+0x4a/0xe0 [1030461.934351] [] ? lookup_fast+0x2a2/0x300 [1030461.940762] [] ? path_openat+0x180/0x1510 [1030461.947271] [] ? dput+0x2f/0x240 [1030461.952906] [] ? walk_component+0xea/0x440 [1030461.959509] [] ? do_filp_open+0x91/0x100 [1030461.965920] [] ? __check_object_size+0x10b/0x1dc [1030461.973107] [] ? do_sys_open+0x127/0x210 [1030461.979517] [] ? system_call_fast_compare_end+0xc/0x9b [1030461.987284] Code: d0 66 31 c0 41 39 c0 74 e6 4d 85 c9 c6 07 01 74 2d 41 c7 41 08 01 00 00 00 e9 52 ff ff ff 83 fa 01 74 17 8b 07 84 c0 74 08 f3 90 <8b> 07 84 c0 75 f8 b8 01 00 00 00 66 89 07 c3 f3 c3 f3 90 4c 8b