Uploaded image for project: ' AGL Development'
  1. AGL Development
  2. SPEC-800

Unable to reboot cleanly using netboot

XMLWordPrintable

    • Icon: Bug Bug
    • Resolution: Won't Fix
    • Icon: Minor Minor
    • None
    • Dab, Eel, Flounder
    • Kernel/ OS
    • 08022017 master build on dra7xx-evm but should be non-platform specific.

      Using AGL-style nbd-based netboot and issuing a reboot to cleanly shutdown and restart results in the following:

      .
      .
      .
      [ OK ] Stopped Load Kernel Modules.
      [ OK ] Stopped Rebuild Journal Catalog.
      [ OK ] Stopped target Local File Systems.
      Unmounting /var/volatile...
      Unmounting /run/user/0...
      Unmounting Temporary Directory...
      [ OK ] Stopped Setup Virtual Console.
      [ OK ] Stopped Load/Save Screen Backlight Brightness of backlight:backlight.
      [ OK ] Stopped Load/Save Random Seed.
      [ OK ] Unmounted /var/volatile.
      [ OK ] Unmounted /run/user/0.
      [ OK ] Unmounted Temporary Directory.
      [ OK ] Stopped target Swap.
      [ OK ] Reached target Unmount All Filesystems.
      [ OK ] Stopped target Local File Systems (Pre).
      [ OK ] Stopped Create Static Device Nodes in /dev.
      [ OK ] Stopped Create System Users.
      [ OK ] Stopped Remount Root and Kernel File Systems.
      [ OK ] Removed slice system-systemd\x2dbacklight.slice.
      [ OK ] Reached target Shutdown.
      [10599.088444] watchdog: watchdog0: watchdog did not stop!
      [10599.097897] systemd-shutdow: 28 output lines suppressed due to ratelimiting
      [10599.109909] systemd-shutdown[1]: Sending SIGTERM to remaining processes...
      [10599.117546] block nbd0: Receive control failed (result -512)
      [10599.123332] block nbd0: shutting down socket
      [10599.154840] systemd-journald[198]: Received SIGTERM from PID 1 (systemd-shutdow).
      [10599.170964] systemd-shutdown[1]: Sending SIGKILL to remaining processes...
      [10599.192681] systemd-shutdown[1]: Hardware watchdog 'OMAP Watchdog', version 0
      [10599.200912] systemd-shutdown[1]: Unmounting file systems.
      [10599.206812] systemd-shutdown[1]: Remounting '/' read-only with options 'data=ordered'.
      [10599.242221] block nbd0: Attempted send on closed socket
      [10599.247513] blk_update_request: I/O error, dev nbd0, sector 872
      [10599.253497] EXT4-fs error (device nbd0): ext4_wait_block_bitmap:503: comm kworker/u4:1: Cannot read block bitmap - block_group = 7, block_bitmap = 109
      [10599.267112] ------------[ cut here ]------------
      [10599.271747] Kernel BUG at c03733b8 [verbose debug info unavailable]
      [10599.278040] Internal error: Oops - BUG: 0 [#1] PREEMPT SMP ARM
      [10599.283896] Modules linked in: bc_example(O) pvrsrvkm(O) cmac rfcomm r820t rtl2832 dvb_usb_rtl28xxu dvb_usb_v2 btusb btrtl btbcm btintel usbhid bluetooth xhci_plat_hcd xhci_hcd dwc3 udc_core rpmsg_rpc snd_soc_simple_card snd_soc_simple_card_utils extcon_usb_gpio snd_soc_omap_hdmi_audio ahci_platform libahci_platform libahci libata omap_aes_driver omap_sham omap_wdt scsi_mod ti_vip ti_vpe dwc3_omap ti_sc ti_csc extcon_core ti_vpdma rtc_omap ov1063x omap_des des_generic crypto_engine snd_soc_tlv320aic3x edt_ft5x06 omap_remoteproc virtio_rpmsg_bus rpmsg_core remoteproc sch_fq_codel mocca_usb(O) hdm_usb(O) usbcore usb_common hdm_i2c(O) hdm_dim2(O) cmemk(O) aim_v4l2(O) aim_sound(O) aim_network(O) aim_cdev(O) mostcore(O) [last unloaded: pvrsrvkm]
      [10599.350223] CPU: 1 PID: 16321 Comm: kworker/u4:1 Tainted: G O 4.9.40-g5db0c78496 #2
      [10599.359044] Hardware name: Generic DRA74X (Flattened Device Tree)
      [10599.365169] Workqueue: writeback wb_workfn (flush-43:0)
      [10599.370427] task: ea004e00 task.stack: ea2cc000
      [10599.374978] PC is at submit_bh_wbc+0x188/0x1fc
      [10599.379439] LR is at __sync_dirty_buffer+0x8c/0x104
      [10599.384336] pc : [<c03733b8>] lr : [<c0375ac8>] psr: 600f0013
      [10599.384336] sp : ea2cd888 ip : ea2cd8b0 fp : ea2cd8ac
      [10599.395859] r10: c1003270 r9 : 00000000 r8 : 00000000
      [10599.401104] r7 : 00000001 r6 : 00000148 r5 : 00000001 r4 : ee58bd00
      [10599.407656] r3 : 00620005 r2 : 00620005 r1 : 00000148 r0 : 00000001
      [10599.414210] Flags: nZCv IRQs on FIQs on Mode SVC_32 ISA ARM Segment user
      [10599.421373] Control: 30c5387d Table: ab1f2c00 DAC: 55555555
      [10599.427139] Process kworker/u4:1 (pid: 16321, stack limit = 0xea2cc210)
      [10599.433778] Stack: (0xea2cd888 to 0xea2ce000)
      [10599.438152] d880: ee58bd00 00000001 00000148 c1003194 ee58bd00 ed08e400
      [10599.446364] d8a0: ea2cd8d4 ea2cd8b0 c0375ac8 c037323c 00000000 ea2cd8c0 c0370898 ed04f400
      [10599.454575] d8c0: 0000eba0 c1003084 ea2cd914 ea2cd8d8 c03c8558 c0375a48 000c671d 00000000
      [10599.462786] d8e0: ea2cd914 00000001 c03c69ec ed04f400 c0a13af0 000001f7 00000000 00000007
      [10599.470998] d900: 00000000 c108874c ea2cd948 ea2cd918 c03c8888 c03c8304 ea00525c ea2cd928
      [10599.479209] d920: ed04f400 ea2cd950 c0bb8238 ea2cd924 e9e2a3c0 ed04f400 0000006d ea2cd984
      [10599.487420] d940: ea2cd950 c03ae140 c03c8840 c0bb8238 00000007 eb1f5000 0000006d 00000000
      [10599.495629] d960: ed04f400 e9e2a3c0 ed04f400 00000007 e9e85b20 ed04f400 ea2cd9a4 ea2cd988
      [10599.503840] d980: c03af0a4 c03ae08c ee591000 ed04f800 ed04f400 e9e85b20 ea2cda04 ea2cd9a8
      [10599.512050] d9a0: c03e2720 c03af07c ee02e9c0 000001c0 00000000 00000006 ebdb2698 eb1f6000
      [10599.520260] d9c0: ebdb2674 eb1f5000 ed04f800 00000000 0000000c 00000007 c032ebc0 ea2cdad8
      [10599.528471] d9e0: ed04f800 ee591000 ea2cdac8 ed04f400 00000000 c108874c ea2cda7c ea2cda08
      [10599.536681] da00: c03e3ccc c03e26e0 00000000 e9e85b20 e9ef4360 e9ef4330 ea2cda7c ea2cda28
      [10599.544892] da20: c03d46ec c032e71c 00158eb3 00000000 00000000 00000000 00000400 00000000
      [10599.553103] da40: 00000000 00000000 e9e85b20 e9ef42b0 00000000 00000000 ea2cdcd0 00000000
      [10599.561313] da60: 00000000 e9ef4360 00000001 00000425 ea2cdb3c ea2cda80 c03d8c54 c03e3a2c
      [10599.569523] da80: ea2cdac4 ea2cda90 c02640b0 c025b76c 00024895 00000000 ea2cdac4 ea2cdaa8
      [10599.577733] daa0: c02758d8 c0289080 ea004e80 eb742af8 00000000 e9e85b20 ed04f800 ea2cdac8
      [10599.585943] dac0: eb1f28c0 00000000 00000000 00000000 00000001 00000000 e9ef4360 00000001
      [10599.594154] dae0: 00000000 00000000 00000000 eb742af8 00008000 00000000 00000000 00000000
      [10599.602364] db00: 00000000 00000000 00002420 00000001 ea2cdb3c ea2cdcd0 e9ef4360 00000425
      [10599.610575] db20: e9e85b20 00000000 e9ef4330 ea2cdd90 ea2cdba4 ea2cdb40 c03b6708 c03d8324
      [10599.618785] db40: efd386d8 00000001 7fffffff c104d840 ea2cdbb4 ea2cdb60 c02f5424 c02ed3e0
      [10599.626995] db60: 00000000 00000000 00000001 c0a0d858 ffffffff 27ffffff 00000001 e9ef4360
      [10599.635206] db80: e9e85b20 00000000 00000000 ea2cdcb8 000007ff ea2cdd90 ea2cdc5c ea2cdba8
      [10599.643415] dba0: c03b9be8 c03b65b0 ea2cdbcc ea2cdbb8 c02f69c8 c02f5180 ea2cdcb8 ea2cdc9f
      [10599.651626] dbc0: e9ef4360 fffff000 ea2cdcd0 e9e85b20 0000000e eb1aee00 ea2cdc0c 00000002
      [10599.659836] dbe0: 00000000 00000000 00000001 00000001 00000000 00000000 efd386d8 ea2cdd90
      [10599.668046] dc00: ea2cdc34 ea2cdc10 c03f46f0 c03f3c98 02400040 00000000 ed04f400 00000002
      [10599.676255] dc20: 00000008 00000ac0 ea2cdc5c ea2cdc38 c03db794 e9ef4360 e9e85b20 00000000
      [10599.684466] dc40: 00000000 024000c0 000007ff ea2cdd90 ea2cdd2c ea2cdc60 c03ba870 c03b9b40
      [10599.692677] dc60: 00000000 eb1aee00 ea2cdd14 ea2cdc78 000068d8 00000001 c0bb8b88 00000000
      [10599.700888] dc80: e9ef4454 ed04f800 00000001 fffff000 00000000 ed04fb98 ea2cdccc 002cdca8
      [10599.709098] dca0: c025b684 c04f0654 00000000 00000000 eb742af8 edec7580 e9ef4360 ea2cdd90
      [10599.717308] dcc0: 00000000 00000001 ffffffff c025b60c 00000000 00000000 00000000 00000001
      [10599.725519] dce0: 00000000 ea2cdcf0 ea2cdd90 00000000 ee59b7e0 eb742af8 00001310 00000000
      [10599.733729] dd00: ea2cdd34 e9ef4360 ea2cdd90 e9ef4360 e9ef4454 ed194940 ee3ec114 fffffc00
      [10599.741939] dd20: ea2cdd3c ea2cdd30 c02f3ee8 c03ba2d0 ea2cdd64 ea2cdd40 c036a0f4 c02f3ec8
      [10599.750150] dd40: ee3ec100 e9ef4400 e9ef4360 ed04f400 ed194940 ee3ec114 ea2cddfc ea2cdd68
      [10599.758360] dd60: c036a7b8 c036a0d0 00000800 7fffffff 00000000 ee3ec12c e9ef43b8 c107e418
      [10599.766571] dd80: 000fb724 c1002d00 ea2cc000 00000000 7fffffff 00000000 00000000 00000000
      [10599.774781] dda0: ffffffff 7fffffff 00000000 00000004 00000000 00000000 00000000 00000000
      [10599.782992] ddc0: 00000000 00000000 00000000 00000000 ea2cddfc ee3ec100 ed194940 ee3ec1fc
      [10599.791203] dde0: 000fb724 c1002d00 ee3ec12c c101a7f8 ea2cde54 ea2cde00 c036ab4c c036a5a4
      [10599.799414] de00: 00003ca0 ee3ec200 ee3ec100 000fb724 ea2cde10 ea2cde10 ea2cde18 ea2cde18
      [10599.807624] de20: ea2cde20 ea2cde20 eb742ac0 ed194958 ee3ec208 ee3ec1fc ee3ec100 ee3ec200
      [10599.815834] de40: ee87bdf8 ed194940 ea2cded4 ea2cde58 c036b148 c036aa7c 00000000 c1002d00
      [10599.824045] de60: c101a7fc ee3ec104 c024c704 eb742ac0 ea004e00 edec7500 00000000 ed2a0380
      [10599.832254] de80: 0000001a 00000000 ea2cdef4 ea2cde98 c08fb594 c02505f4 c022d864 c022d4b4
      [10599.840464] dea0: 00000000 00000000 d19845b9 ee3ec208 e43a3b80 ee80bc00 00000000 eeaf9f00
      [10599.848673] dec0: 00000000 e43a3b80 ea2cdf0c ea2cded8 c0244e10 c036b070 c1002d00 ee80bc18
      [10599.856884] dee0: ea2cc000 ee80bc00 e43a3b98 00000088 c1002d00 ee80bc18 ea2cc000 e43a3b80
      [10599.865093] df00: ea2cdf54 ea2cdf10 c0245a5c c0244c40 ea2cdf34 c0ba7898 00000000 ee80bd60
      [10599.873303] df20: ea2cc000 c101a60a 00000000 00000000 e43c2b00 ea2cc000 e43a3b80 c0245a04
      [10599.881514] df40: 00000000 00000000 ea2cdfac ea2cdf58 c024ad70 c0245a10 ea2cdf58 00000000
      [10599.889724] df60: 000000f8 e43a3b80 00000000 00000000 ea2cdf70 ea2cdf70 00000000 00000000
      [10599.897934] df80: ea2cdf80 ea2cdf80 ea2cdfac e43c2b00 c024ac70 00000000 00000000 00000000
      [10599.906144] dfa0: 00000000 ea2cdfb0 c0207b88 c024ac7c 00000000 00000000 00000000 00000000
      [10599.914355] dfc0: 00000000 00000000 00000000 00000000 00000000 00000000 00000000 00000000
      [10599.922565] dfe0: 00000000 00000000 00000000 00000000 00000013 00000000 006f0069 0020006e
      [10599.930772] Backtrace: 
      [10599.933237] [<c0373230>] (submit_bh_wbc) from [<c0375ac8>] (__sync_dirty_buffer+0x8c/0x104)
      [10599.941625] r9:ed08e400 r8:ee58bd00 r7:c1003194 r6:00000148 r5:00000001 r4:ee58bd00
      [10599.949404] [<c0375a3c>] (__sync_dirty_buffer) from [<c03c8558>] (ext4_commit_super+0x260/0x31c)
      [10599.958224] r6:c1003084 r5:0000eba0 r4:ed04f400
      [10599.962861] [<c03c82f8>] (ext4_commit_super) from [<c03c8888>] (__ext4_error+0x58/0xcc)
      [10599.970898] r10:c108874c r9:00000000 r8:00000007 r7:00000000 r6:000001f7 r5:c0a13af0
      [10599.978757] r4:ed04f400
      [10599.981302] [<c03c8834>] (__ext4_error) from [<c03ae140>] (ext4_wait_block_bitmap+0xc0/0xd4)
      [10599.989774] r6:0000006d r5:ed04f400 r4:e9e2a3c0
      [10599.994412] [<c03ae080>] (ext4_wait_block_bitmap) from [<c03af0a4>] (ext4_read_block_bitmap+0x34/0x68)
      [10600.003755] r8:ed04f400 r7:e9e85b20 r6:00000007 r5:ed04f400 r4:e9e2a3c0
      [10600.010486] [<c03af070>] (ext4_read_block_bitmap) from [<c03e2720>] (ext4_mb_mark_diskspace_used+0x4c/0x49c)
      [10600.020354] r7:e9e85b20 r6:ed04f400 r5:ed04f800 r4:ee591000
      [10600.026036] [<c03e26d4>] (ext4_mb_mark_diskspace_used) from [<c03e3ccc>] (ext4_mb_new_blocks+0x2ac/0xa08)
      [10600.035642] r10:c108874c r9:00000000 r8:ed04f400 r7:ea2cdac8 r6:ee591000 r5:ed04f800
      [10600.043500] r4:ea2cdad8
      [10600.046044] [<c03e3a20>] (ext4_mb_new_blocks) from [<c03d8c54>] (ext4_ext_map_blocks+0x93c/0x1034)
      [10600.055040] r10:00000425 r9:00000001 r8:e9ef4360 r7:00000000 r6:00000000 r5:ea2cdcd0
      [10600.062899] r4:00000000
      [10600.065444] [<c03d8318>] (ext4_ext_map_blocks) from [<c03b6708>] (ext4_map_blocks+0x164/0x5a8)
      [10600.074092] r10:ea2cdd90 r9:e9ef4330 r8:00000000 r7:e9e85b20 r6:00000425 r5:e9ef4360
      [10600.081951] r4:ea2cdcd0
      [10600.084496] [<c03b65a4>] (ext4_map_blocks) from [<c03b9be8>] (mpage_map_and_submit_extent+0xb4/0x790)
      [10600.093753] r10:ea2cdd90 r9:000007ff r8:ea2cdcb8 r7:00000000 r6:00000000 r5:e9e85b20
      [10600.101612] r4:e9ef4360
      [10600.104157] [<c03b9b34>] (mpage_map_and_submit_extent) from [<c03ba870>] (ext4_writepages+0x5ac/0x6a4)
      [10600.113502] r10:ea2cdd90 r9:000007ff r8:024000c0 r7:00000000 r6:00000000 r5:e9e85b20
      [10600.121362] r4:e9ef4360
      [10600.123909] [<c03ba2c4>] (ext4_writepages) from [<c02f3ee8>] (do_writepages+0x2c/0x40)
      [10600.131859] r10:fffffc00 r9:ee3ec114 r8:ed194940 r7:e9ef4454 r6:e9ef4360 r5:ea2cdd90
      [10600.139719] r4:e9ef4360
      [10600.142263] [<c02f3ebc>] (do_writepages) from [<c036a0f4>] (__writeback_single_inode+0x30/0x194)
      [10600.151088] [<c036a0c4>] (__writeback_single_inode) from [<c036a7b8>] (writeback_sb_inodes+0x220/0x410)
      [10600.160520] r9:ee3ec114 r8:ed194940 r7:ed04f400 r6:e9ef4360 r5:e9ef4400 r4:ee3ec100
      [10600.168297] [<c036a598>] (writeback_sb_inodes) from [<c036ab4c>] (wb_writeback+0xdc/0x1c8)
      [10600.176596] r10:c101a7f8 r9:ee3ec12c r8:c1002d00 r7:000fb724 r6:ee3ec1fc r5:ed194940
      [10600.184456] r4:ee3ec100
      [10600.187001] [<c036aa70>] (wb_writeback) from [<c036b148>] (wb_workfn+0xe4/0x31c)
      [10600.194427] r10:ed194940 r9:ee87bdf8 r8:ee3ec200 r7:ee3ec100 r6:ee3ec1fc r5:ee3ec208
      [10600.202285] r4:ed194958
      [10600.204830] [<c036b064>] (wb_workfn) from [<c0244e10>] (process_one_work+0x1dc/0x3f8)
      [10600.212692] r10:e43a3b80 r9:00000000 r8:eeaf9f00 r7:00000000 r6:ee80bc00 r5:e43a3b80
      [10600.220551] r4:ee3ec208
      [10600.223095] [<c0244c34>] (process_one_work) from [<c0245a5c>] (worker_thread+0x58/0x578)
      [10600.231218] r10:e43a3b80 r9:ea2cc000 r8:ee80bc18 r7:c1002d00 r6:00000088 r5:e43a3b98
      [10600.239076] r4:ee80bc00
      [10600.241621] [<c0245a04>] (worker_thread) from [<c024ad70>] (kthread+0x100/0x118)
      [10600.249047] r10:00000000 r9:00000000 r8:c0245a04 r7:e43a3b80 r6:ea2cc000 r5:e43c2b00
      [10600.256906] r4:00000000
      [10600.259452] [<c024ac70>] (kthread) from [<c0207b88>] (ret_from_fork+0x14/0x2c)
      [10600.266703] r8:00000000 r7:00000000 r6:00000000 r5:c024ac70 r4:e43c2b00
      [10600.273433] Code: e585100c eb054d0f e3a00000 e89dabf0 (e7f001f2) 
      [10600.279552] ---[ end trace 19a0d90d2c89bec6 ]---
      [10600.284376] Unable to handle kernel paging request at virtual address ffffffec
      [10600.291631] pgd = c0003000
      [10600.294349] [ffffffec] *pgd=80000080007003, *pmd=affae003, *pte=00000000
      

      Looks like the nbd device is being torn down before the kernel's bio workers are done accessing it.

        No reviews matched the request. Check your Options in the drop-down menu of this sections header.

            sdesneux Stephane Desneux
            ohporter Matt Porter
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

              Created:
              Updated:
              Resolved: