Linaro Sudden crash after random period of time on custom SD410E board

Hi,
Im working with 410c and got Sudden crash after random period of time:
only hard reset release it from this stack.
can you tell the reason?
[ 869.927228] msm 1a00000.mdss: master bind failed: -517
[ 869.936115] qcom-apq8016-sbc 7702000.sound: error getting codec dai name
[ 869.938940] qcom-apq8016-sbc 7702000.sound: Error resolving dai links: -517
[ 870.376508] qcom-wcnss-pil a204000.wcnss: fatal error received: halInitApi.c:1576:gpio_spare1_ted
[ 870.376583] remoteproc remoteproc1: crash detected in a204000.wcnss: type fatal error
[ 875.232866] 1a00000.mdss supply vdd not found, using dummy regulator
[ 875.233544] msm 1a00000.mdss: bound 1a01000.mdp (ops mdp5_ops)
[ 875.237005] remoteproc remoteproc1: remote processor a204000.wcnss is now up
[ 875.237031] remoteproc remoteproc1: handling crash #161 in a204000.wcnss
[ 875.237036] remoteproc remoteproc1: recovering a204000.wcnss
[ 875.239383] remoteproc remoteproc1: stopped remote processor a204000.wcnss
[ 875.239390] remoteproc remoteproc1: powering up a204000.wcnss
[ 875.239533] remoteproc remoteproc1: Booting fw image wcnss.mdt, size 7260
[ 875.276788] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 875.285259] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 875.291035] msm_dsi_manager_register: failed to register mipi dsi host for DSI 0
[ 875.296639] msm 1a00000.mdss: failed to bind 1a98000.dsi (ops dsi_ops): -517
[ 875.304426] msm 1a00000.mdss: master bind failed: -517
[ 875.315552] qcom-apq8016-sbc 7702000.sound: error getting codec dai name
[ 875.315626] qcom-apq8016-sbc 7702000.sound: Error resolving dai links: -517
[ 875.324601] 1a00000.mdss supply vdd not found, using dummy regulator
[ 875.330317] msm 1a00000.mdss: bound 1a01000.mdp (ops mdp5_ops)
[ 875.336266] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 875.341902] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 875.348909] msm_dsi_manager_register: failed to register mipi dsi host for DSI 0
[ 875.354902] msm 1a00000.mdss: failed to bind 1a98000.dsi (ops dsi_ops): -517
[ 875.362381] msm 1a00000.mdss: master bind failed: -517
[ 875.668999] qcom-wcnss-pil a204000.wcnss: fatal error received: halInitApi.c:1576:gpio_spare1_ted
[ 875.669067] remoteproc remoteproc1: crash detected in a204000.wcnss: type fatal error
[ 880.351590] remoteproc remoteproc1: remote processor a204000.wcnss is now up
[ 880.351683] remoteproc remoteproc1: handling crash #162 in a204000.wcnss
[ 880.362905] remoteproc remoteproc1: recovering a204000.wcnss
[ 880.366252] remoteproc remoteproc1: stopped remote processor a204000.wcnss
[ 880.373137] remoteproc remoteproc1: powering up a204000.wcnss
[ 880.377306] remoteproc remoteproc1: Booting fw image wcnss.mdt, size 7260
[ 880.384961] qcom-apq8016-sbc 7702000.sound: error getting codec dai name
[ 880.389415] qcom-apq8016-sbc 7702000.sound: Error resolving dai links: -517
[ 880.397076] 1a00000.mdss supply vdd not found, using dummy regulator
[ 880.403335] msm 1a00000.mdss: bound 1a01000.mdp (ops mdp5_ops)
[ 880.409542] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 880.415305] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 880.422282] msm_dsi_manager_register: failed to register mipi dsi host for DSI 0
[ 880.428149] msm 1a00000.mdss: failed to bind 1a98000.dsi (ops dsi_ops): -517
[ 880.435670] msm 1a00000.mdss: master bind failed: -517
[ 880.875963] qcom-wcnss-pil a204000.wcnss: fatal error received: halInitApi.c:1576:gpio_spare1_ted
[ 880.876030] remoteproc remoteproc1: crash detected in a204000.wcnss: type fatal error
[ 885.727612] remoteproc remoteproc1: remote processor a204000.wcnss is now up
[ 885.727687] remoteproc remoteproc1: handling crash #163 in a204000.wcnss
[ 885.738692] remoteproc remoteproc1: recovering a204000.wcnss
[ 885.743855] remoteproc remoteproc1: stopped remote processor a204000.wcnss
[ 885.746075] remoteproc remoteproc1: powering up a204000.wcnss
[ 885.754625] remoteproc remoteproc1: Booting fw image wcnss.mdt, size 7260
[ 885.761682] qcom-apq8016-sbc 7702000.sound: error getting codec dai name
[ 885.766669] qcom-apq8016-sbc 7702000.sound: Error resolving dai links: -517
[ 885.775528] 1a00000.mdss supply vdd not found, using dummy regulator
[ 885.779892] msm 1a00000.mdss: bound 1a01000.mdp (ops mdp5_ops)
[ 885.785789] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 885.792803] 1a98000.dsi supply gdsc not found, using dummy regulator
[ 885.798514] msm_dsi_manager_register: failed to register mipi dsi host for DSI 0
[ 885.804293] msm 1a00000.mdss: failed to bind 1a98000.dsi (ops dsi_ops): -517
[ 885.811638] msm 1a00000.mdss: master bind failed: -517
[ 886.243741] qcom-wcnss-pil a204000.wcnss: fatal error received: halInitApi.c:1576:gpio_spare1_ted
[ 886.243810] remoteproc remoteproc1: crash detected in a204000.wcnss: type fatal error
[ 891.103565] remoteproc remoteproc1: remote processor a204000.wcnss is now up
[ 891.103634] remoteproc remoteproc1: handling crash #164 in a204000.wcnss
[ 891.113886] remoteproc remoteproc1: recovering a204000.wcnss
[ 891.117312] Unable to handle kernel paging request at virtual address 14000000fa
[ 891.122410] pgd = ffff00000914e000
[ 891.129447] [14000000fa] *pgd=00000000b7ffe003[ 891.132640] , *pud=0000000000000000
[ 891.137987]
[ 891.140293] Internal error: Oops: 96000045 [#1] PREEMPT SMP
[ 891.141983] Modules linked in:
venus_decom syslogd@linaro-alip at Oct 15 14:50:33 …
kernel:[ 891.140293] Internal error: Oops: 96000045 [#1] PRE uvcvideEMPT SMPo videobuf2_vmalloc
venus_core qcom_camss videobuf2_dma_sg mdt_loader videobuf2_memops v4l2_mem2mem qcom_cci videobuf2s
[ 891.177971] CPU: 1 PID: 1501 Comm: kworker/1:5 Tainted: G W 4.9.39-linaro-lt-qcom #1
[ 891.178084] Hardware name: Qualcomm Technologies, Inc. APQ 8016 SBC (DT)
[ 891.186939] Workqueue: events rproc_crash_handler_work
[ 891.198625] task: ffff80003674a700 task.stack: ffff800036018000
[ 891.198730] PC is at qcom_smd_edge_release+0x20/0x98
[ 891.204457] LR is at device_release+0x34/0x98
[ 891.209660] pc : [] lr : [] pstate: 80000145
[ 891.213927] sp : ffff80003601bc20
[ 891.221375] x29: ffff80003601bc20 x28: 0000000000000000
[ 891.229700] x27: 0000000000000000 x26: 0000000000000000
[ 891.234995] x25: ffff000008fd4e5a x24: ffff800037f43280
[ 891.240289] x23: ffff800035fc3838 x22: ffff800035fc3b10
[ 891.245584] x21: ffff800036089b00 x20: ffff80001e584c10
[ 891.250879] x19: ffff80001e584c00 x18: 0000000000000000
[ 891.256174] x17: 0000ffff922f6b90 x16: ffff0000081f9598
[ 891.261470] x15: ffffffffffffffff x14: ffff80001f58191c
[ 891.266764] x13: ffffff0000000000 x12: ffffffffffffffff
[ 891.272061] x11: 0000000000000040 x10: ffff800036823010
[ 891.277355] x9 : ffff800036823078 x8 : 0000000000000000
[ 891.282650] x7 : ffff80003528e200 x6 : ffff80003528e200
[ 891.287945] x5 : ffff800036822fe8 x4 : 0000000000000000
[ 891.293240] x3 : ffff80001e584ef8 x2 : 00000014000000ce
[ 891.298536] x1 : ffff80002e9e5718 x0 : ffff80001e584c00
[ 891.303830]
[ 891.304012] Process kworker/1:5 (pid: 1501, stack limit = 0xffff800036018020)
[ 891.305587] Stack: (0xffff80003601bc20 to 0xffff80003601c000)
[ 891.312618] bc20: ffff80003601bc30 ffff0000085a5a0c ffff80003601bc60 ffff000008398efc
[ 891.318360] bc40: ffff80001e584c10 ffff000009058c20 ffff80001f6a7d80 ffff800035fc3800
[ 891.326172] bc60: ffff80003601bc90 ffff0000085a65c8 ffff80001e584c00 ffff800035fc3800
[ 891.333984] bc80: ffff800035fc3bb0 ffff800035fc3800 ffff80003601bcb0 ffff00000886e814
[ 891.341797] bca0: ffff80001e584c00 0000000000000000 ffff80003601bcd0 ffff00000886abb0
[ 891.349610] bcc0: ffff800035fc3d40 ffff000008869790 ffff80003601bcf0 ffff0000088695ec
[ 891.357421] bce0: ffff800035fc3d40 ffff80003601bd30 ffff80003601bd30 ffff0000088697b8
[ 891.365234] bd00: ffff800035fc3800 ffff800035fc3c18 ffff800035fc3b10 ffff800035fc3838
[ 891.373046] bd20: ffff800037f47900 000000000000000d ffff80003601bd50 ffff0000088698d0
[ 891.380860] bd40: ffff800035fc3800 ffff800035fc3800 ffff80003601bd80 ffff0000080d56bc
[ 891.388671] bd60: 0000000000000000 ffff800036088700 ffff800035fc3bf0 0000000000000000
[ 891.396483] bd80: ffff80003601bdc0 ffff0000080d5be4 ffff800036088700 ffff800037f43280
[ 891.404297] bda0: ffff800036088730 ffff800037f432a0 ffff000008fb6000 ffff800036018000
[ 891.412109] bdc0: ffff80003601be20 ffff0000080db67c ffff800035dd3d00 ffff800036018000
[ 891.419923] bde0: ffff000008d2aac8 ffff800036088700 ffff0000080d5870 0000000000000000
[ 891.427734] be00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.435546] be20: 0000000000000000 ffff000008082e80 ffff0000080db598 ffff800035dd3d00
[ 891.443358] be40: 0000000000000000 0000000000000000 0000000000000000 36f8074094017a46
[ 891.451173] be60: ffff80003601bea0 0000000000000000 ffff0000080db598 ffff800036088700
[ 891.458984] be80: 0000000000000000 0000000000000000 ffff80003601be90 ffff80003601be90
[ 891.466786] bea0: 0000000000000000 ffff000000000000 ffff80003601beb0 ffff80003601beb0
[ 891.474598] bec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.482410] bee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.490223] bf00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.498035] bf20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.505847] bf40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.513659] bf60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.521472] bf80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.529284] bfa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 891.537098] bfc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[ 891.544909] bfe0: 0000000000000000 0000000000000000 f9472000f0000720 b8606820d53bd041
[ 891.552723] Call trace:
[ 891.560521] Exception stack(0xffff80003601ba50 to 0xffff80003601bb80)
[ 891.562792] ba40: ffff80001e584c00 0001000000000000
[ 891.569390] ba60: ffff80003601bc20 ffff00000886da48 ffff8000360ccc00 ffff8000360ccc38
[ 891.577203] ba80: ffff000009122000 ffff8000360ccc00 0000000000000000 ffff000009122000
[ 891.585015] baa0: ffff000008fd4e5a 0000000000000000 ffff80003601bad0 ffff000008250f38
[ 891.592827] bac0: ffff8000360ccc00 ffff80003601bac0 ffff80003601bb00 ffff00000810a0fc
[ 891.600640] bae0: ffff80003528e200 ffff80003528e220 ffff80001e584c00 ffff80002e9e5718
[ 891.608452] bb00: 00000014000000ce ffff80001e584ef8 0000000000000000 ffff800036822fe8
[ 891.616264] bb20: ffff80003528e200 ffff80003528e200 0000000000000000 ffff800036823078
[ 891.624076] bb40: ffff800036823010 0000000000000040 ffffffffffffffff ffffff0000000000
[ 891.631889] bb60: ffff80001f58191c ffffffffffffffff ffff0000081f9598 0000ffff922f6b90
[ 891.639708] [] qcom_smd_edge_release+0x20/0x98
[ 891.647509] [] device_release+0x34/0x98
[ 891.653583] [] kobject_put+0x94/0x218
[ 891.658877] [] device_unregister+0x28/0x70
[ 891.663915] [] qcom_smd_unregister_edge+0x5c/0x70
[ 891.669817] [] smd_subdev_remove+0x18/0x28
[ 891.675803] [] rproc_shutdown+0x84/0x170
[ 891.681706] [] rproc_trigger_recovery+0x50/0x70
[ 891.687002] [] rproc_crash_handler_work+0xf8/0x108
[ 891.693168] [] process_one_work+0x1b4/0x368
[ 891.699588] [] worker_thread+0x374/0x490
[ 891.705230] [] kthread+0xe4/0xf8
[ 891.710613] [] ret_from_fork+0x10/0x50
[ 891.715387] Code: d102a041 eb02007f 540001a1 1400001c (b9002c5f)
[ 891.721634] —[ end trace f1485f2f84d1da8a ]—
[ 891.726983] Unable to handle kernel paging request at virtual address ffffffffffffffd8
[ 891.731550] pgd = ffff80002f884000
[ 891.739253] [ffffffffffffffd8] *pgd=00000000afcda003[ 891.742635] , *pud=00000000ae8fe003
, *pmd=0000000000000000
[ 891.751141]
Message from syslogd@linaro-alip at Oct 15 14:50:33 …[ 891.754115] Internal error: Oops: 9600000P

kernel:[ 891.304012] Process kworker/1:5 (pid: 1501, stack limit = 0xffff80 ven0036us_e0180nc sms)
rng_core venus_corerng
qcom_camssMessage from syslogd@linaro-alip at Oct 15 14:50:33 … videobuf2_dma_sg
videobuf2_memops v4l2_mem2mem qcom_cci kernel:[ 891.305587] Stack: (0xffff80003601bc20 to 0xffff82

Message from syslogd@linaro-alip at Oct 15 14:50:33 .[ 891.799376] Hardware name: Qualcomm Technol)

kernel:[ 891.312618] bc20: ffff80003601bc30 ffff0000085a5a0c ffff80003601bc60 ffff000008398efc
[ 891.811548] PC is at kthread_data+0x4/0x10

[ 891.824760] pc : [] lr : [] pstate: 800001c5
[ 891.824795] sp : ffff80003601b860
Message from syslogd@linaro-alip at Oct 15 14:50:33 …
[ 891.831455] x29: ffff80003601b860 1e584c10 ffff000009058c20 ffff80001f6a7d80 ffff800035fc3800
[ 891.852725] x27: ffff80000a178000
x26: 0000000000000000 Message from syslogd@linaro-alip at Oct 15 14:50:33 …

x24: ffff80003674acd0
kernel:[ 891.326172] bc60: ffff80003601bc90 ffff0000085a65c8 ffff80001e584c00 ffff800035fc3800[
[ 891.877676] x21: ffff000008fb7000 x20: ffff000008f7d000

[ 891.882027] x19: ffff800037f43a80 Message from syslogd@linaro-alip at Oct 15 14:50:33 …x18: 00
93659] x17: 0000000000000001 x16: 0000000000000019 00035fc3800 ffff80[ 8003601bcb0 ffff00000886e914
[ 891.907918] x15: 0000000000000033 x14: 000000000000004c
Message from syslogd@linaro-alip at Oct 15 14:50:33 …

kernel:[ 891.341797] bca0: ffff80001e584c00 0000000000000000
ffff80003601bcd0 ffff00000886abb0
x6 : 0000000000000001 01010101010101

[ 891.932508] x5 : 0000000000000000 Message from syslogd@linaro-alip at Oct 15 14:50:33 …x4 : ff
kernel:[ 891.349610] bcc0: ffff800035fc3d40 ffff0000088x2 :69790 ffff80003601bc ffff0 ff000fff000
5ec

Message from syslogd@linaro-alip at Oc
t 15 14:50:33 …[ 891.954805]
.
kernel:[ 891.357421] bce0: ffff800035fc3d40 ffff80003601bd30 ffff8[ 80003601bd30 ffff0000088697b0
[ 891.962528] b880: ffff80003674a700 ffff80003601b448 ffff80003601b940 ffff80003674abc0

[ 891.987183] b8c0: ffff80003674a700 ffff80003601b448 ffff80003601b8e0 ffff0000080c2518
[ 891.987219] b8e0: ffff80003601b950 ffff000008088a50 ffff000009100000 ffff80003601baf0
[ 891.994324] b900: 0000000000000000 ffff000008d24c10 ffff800036018000 ffff80003674a700
[ 892.002136] b920: ffff000008fd4e5a 0000000000000000 0000000000000000 ffff800036018000
[ 892.009947] b940: ffff80003601b940 ffff80003601b940 ffff80003601b990 ffff00000809972c
[ 892.017760] b960: 00000014000000fa ffff80003601baf0 0000000096000045 0000000000000000
[ 892.025573] b980: 00000014000000fa 0000000000000025 ffff80003601b9c0 ffff000008096e84
[ 892.033385] b9a0: ffff80003674a700 ffff80003601baf0 0000000000000000 0000000096000045
[ 892.041198] b9c0: ffff80003601ba30 ffff000008096f94 0000000096000045 ffff000008a38088
[ 892.049011] b9e0: 00000014000000fa ffff80003601baf0 0000000080000145 0000000000000025
[ 892.056823] ba00: ffff000008fd4e5a 0000000000000000 0000000000000000 ffff800036018000
[ 892.064635] ba20: 0000000000000000 0000000000000001 ffff80003601ba40 ffff000008081298
[ 892.072448] ba40: ffff80003601bc20 ffff0000080825d0 ffff80001e584c00 0001000000000000
[ 892.080261] ba60: ffff80003601bc20 ffff00000886da48 ffff8000360ccc00 ffff8000360ccc38
[ 892.088072] ba80: ffff000009122000 ffff8000360ccc00 0000000000000000 ffff000009122000
[ 892.095886] baa0: ffff000008fd4e5a 0000000000000000 ffff80003601bad0 ffff000008250f38
[ 892.103697] bac0: ffff8000360ccc00 ffff80003601bac0 ffff80003601bb00 ffff00000810a0fc
[ 892.111511] bae0: ffff80003528e200 ffff80003528e220 ffff80001e584c00 ffff80002e9e5718
[ 892.119323] bb00: 00000014000000ce ffff80001e584ef8 0000000000000000 ffff800036822fe8
[ 892.127136] bb20: ffff80003528e200 ffff80003528e200 0000000000000000 ffff800036823078
[ 892.134948] bb40: ffff800036823010 0000000000000040 ffffffffffffffff ffffff0000000000
[ 892.142760] bb60: ffff80001f58191c ffffffffffffffff ffff0000081f9598 0000ffff922f6b90
[ 892.150573] bb80: 0000000000000000 ffff80001e584c00 ffff80001e584c10 ffff800036089b00
[ 892.158385] bba0: ffff800035fc3b10 ffff800035fc3838 ffff800037f43280 ffff000008fd4e5a
[ 892.166198] bbc0: 0000000000000000 0000000000000000 0000000000000000 ffff80003601bc20
[ 892.174011] bbe0: ffff0000085a5a0c ffff80003601bc20 ffff00000886da48 0000000080000145
[ 892.181823] bc00: ffff80001f6a7680 ffff80001e5dfb80 ffffffffffffffff ffff0000085a59fc
[ 892.189636] bc20: ffff80003601bc30 ffff0000085a5a0c ffff80003601bc60 ffff000008398efc
[ 892.197448] bc40: ffff80001e584c10 ffff000009058c20 ffff80001f6a7d80 ffff800035fc3800
[ 892.205261] bc60: ffff80003601bc90 ffff0000085a65c8 ffff80001e584c00 ffff800035fc3800
[ 892.213073] bc80: ffff800035fc3bb0 ffff800035fc3800 ffff80003601bcb0 ffff00000886e814
[ 892.220885] bca0: ffff80001e584c00 0000000000000000 ffff80003601bcd0 ffff00000886abb0
[ 892.228698] bcc0: ffff800035fc3d40 ffff000008869790 ffff80003601bcf0 ffff0000088695ec
[ 892.236511] bce0: ffff800035fc3d40 ffff80003601bd30 ffff80003601bd30 ffff0000088697b8
[ 892.244323] bd00: ffff800035fc3800 ffff800035fc3c18 ffff800035fc3b10 ffff800035fc3838
[ 892.252136] bd20: ffff800037f47900 000000000000000d ffff80003601bd50 ffff0000088698d0
[ 892.259948] bd40: ffff800035fc3800 ffff800035fc3800 ffff80003601bd80 ffff0000080d56bc
[ 892.267760] bd60: 0000000000000000 ffff800036088700 ffff800035fc3bf0 0000000000000000
[ 892.275573] bd80: ffff80003601bdc0 ffff0000080d5be4 ffff800036088700 ffff800037f43280
[ 892.283385] bda0: ffff800036088730 ffff800037f432a0 ffff000008fb6000 ffff800036018000
[ 892.291198] bdc0: ffff80003601be20 ffff0000080db67c ffff800035dd3d00 ffff800036018000
[ 892.299009] bde0: ffff000008d2aac8 ffff800036088700 ffff0000080d5870 0000000000000000
[ 892.306822] be00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.314635] be20: 0000000000000000 ffff000008082e80 ffff0000080db598 ffff800035dd3d00
[ 892.322447] be40: 0000000000000000 0000000000000000 0000000000000000 36f8074094017a46
[ 892.330260] be60: ffff80003601bea0 0000000000000000 ffff0000080db598 ffff800036088700
[ 892.338072] be80: 0000000000000000 0000000000000000 ffff80003601be90 ffff80003601be90
[ 892.345885] bea0: 0000000000000001 ffff000000010001 ffff80003601beb0 ffff80003601beb0
[ 892.353699] bec0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.361510] bee0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.369322] bf00: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.377136] bf20: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.384947] bf40: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.392759] bf60: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.400572] bf80: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.408384] bfa0: 0000000000000000 0000000000000000 0000000000000000 0000000000000000
[ 892.416198] bfc0: 0000000000000000 0000000000000005 0000000000000000 0000000000000000
[ 892.424010] bfe0: 0000000000000000 0000000000000000 f9472000f0000720 b8606820d53bd041
[ 892.431820] Call trace:
[ 892.439618] Exception stack(0xffff80003601b690 to 0xffff80003601b7c0)
[ 892.441883] b680: ffff800037f43a80 0001000000000000
[ 892.448490] b6a0: ffff80003601b860 ffff0000080dc054 ffff80003601b6c0 ffff00000824a620
[ 892.456302] b6c0: ffff80003601b6f0 ffff000008259484 ffff0000091220a0 ffff800035a13528
[ 892.464114] b6e0: 00000000000001c0 0000000000000080 ffff80003601b750 ffff00000825956c
[ 892.471926] b700: ffff80003601b720 ffff0000081009a0 0000000000010025 0000000000000000
[ 892.479739] b720: ffff80003601b750 ffff0000080ee000 0000000000000000 0000000000000000
[ 892.487551] b740: ffff000009106b80 0000000000000001 ffff800037f443f8 0000000000000000
[ 892.495363] b760: 0000000000000001 ffff800037f43b40 000000cf8f533741 ffff80003674a780
[ 892.503176] b780: 0000000002f702bf 0101010101010101 0000000000000008 0000000000000068
[ 892.510990] b7a0: 000000000000004c 0000000000000033 0000000000000019 0000000000000001
[ 892.518805] [] kthread_data+0x4/0x10
[ 892.526608] [] __schedule+0x488/0x610
[ 892.531640] [] do_task_dead+0x78/0x80
[ 892.536763] [] do_exit+0x6c8/0x9a8
[ 892.541980] [] die+0x198/0x1b0
[ 892.547181] [] __do_kernel_fault.part.1+0x70/0x84
[ 892.551785] [] do_page_fault+0x354/0x358
[ 892.557767] [] do_translation_fault+0x3c/0x48
[ 892.563324] [] do_mem_abort+0x40/0x98
[ 892.569137] Exception stack(0xffff80003601ba50 to 0xffff80003601bb80)
[ 892.574349] ba40: ffff80001e584c00 0001000000000000
[ 892.580955] ba60: ffff80003601bc20 ffff00000886da48 ffff8000360ccc00 ffff8000360ccc38
[ 892.588767] ba80: ffff000009122000 ffff8000360ccc00 0000000000000000 ffff000009122000
[ 892.596579] baa0: ffff000008fd4e5a 0000000000000000 ffff80003601bad0 ffff000008250f38
[ 892.604392] bac0: ffff8000360ccc00 ffff80003601bac0 ffff80003601bb00 ffff00000810a0fc
[ 892.612205] bae0: ffff80003528e200 ffff80003528e220 ffff80001e584c00 ffff80002e9e5718
[ 892.620017] bb00: 00000014000000ce ffff80001e584ef8 0000000000000000 ffff800036822fe8
[ 892.627829] bb20: ffff80003528e200 ffff80003528e200 0000000000000000 ffff800036823078
[ 892.635642] bb40: ffff800036823010 0000000000000040 ffffffffffffffff ffffff0000000000
[ 892.643454] bb60: ffff80001f58191c ffffffffffffffff ffff0000081f9598 0000ffff922f6b90
[ 892.651272] [] el1_da+0x24/0x84
[ 892.659079] [] device_release+0x34/0x98
[ 892.663760] [] kobject_put+0x94/0x218
[ 892.669139] [] device_unregister+0x28/0x70
[ 892.674177] [] qcom_smd_unregister_edge+0x5c/0x70
[ 892.680079] [] smd_subdev_remove+0x18/0x28
[ 892.686067] [] rproc_shutdown+0x84/0x170
[ 892.691968] [] rproc_trigger_recovery+0x50/0x70
[ 892.697265] [] rproc_crash_handler_work+0xf8/0x108
[ 892.703432] [] process_one_work+0x1b4/0x368
[ 892.709852] [] worker_thread+0x374/0x490
[ 892.715493] [] kthread+0xe4/0xf8
[ 892.720875] [] ret_from_fork+0x10/0x50
[ 892.725651] Code: d65f03c0 d4210000 17fffff6 f942b800 (f85d8000)

[ 912.730823] INFO: rcu_sched detected stalls on CPUs/tasks:
[ 912.735192] 1-…: (1 ticks this GP) idle=af7/140000000000001/0 softirq=13778/13778 fqs=2449
[ 912.735294] (detected by 3, t=5252 jiffies, g=1085, c=1084, q=2)
[ 912.745090] Task dump for CPU 1:
[ 912.749948] kworker/1:5 x 0 1501 0 0x00000000
[ 912.755769] Call trace:
[ 912.758547] [] __switch_to+0x8c/0xa0
[ 912.760891] [] 0xffff80003601b448
[ 912.766119] INFO: rcu_preempt detected stalls on CPUs/tasks:
[ 912.776423] 1-…: (1 GPs behind) idle=af7/140000000000001/0 softirq=13774/13778 fqs=2450
[ 912.776699] (detected by 3, t=5258 jiffies, g=6063, c=6062, q=10594)
[ 912.786236] Task dump for CPU 1:
[ 912.791440] kworker/1:5 x 0 1501 0 0x00000000
[ 912.797259] Call trace:
[ 912.800035] [] __switch_to+0x8c/0xa0
[ 912.802383] [] 0xffff80003601b448

When WiFi firmware crashes, remoteproc framework detects it and tries to recover/restart the chip.
This includes unregistering and re-registering of the device to the driver.
Here, something goes wrong on the unregistering path:

Unable to handle kernel paging request at virtual address 14000000fa
Internal error: Oops: 96000045 [#1] PREEMPT SMP
qcom_smd_edge_release+0x20/0x98
device_release+0x34/0x98
kobject_put+0x94/0x218
device_unregister+0x28/0x7

@bamse, is it a known issue ?

@Loic, I’ve not seen this before.

The problem in the firmware seems to be some funky hardware state (from the error message), but the crash seems to indicate that there’s might be something going wrong in the recovery mechanism - or something else (firmware or some other driver) has trashed some memory in the process…

Another takeaway from this log is that we should probably adopt the downstream Qualcomm feature of giving up after a few failed attempts to recover. Apparently the first 163 attempts failed to get WiFi back on track…

On my board I didn’t install the Wi-Fi chip.
So it’s needs to be disabled on the kernel.
Can you please advise how?

Thx
Ofer

So that mean you were not using wifi (interface down) when this crash happened ?

In your case I suppose you can disable the node in the device-tree (apq8016-sbc.dtsi) by removing:

wcnss@a21b000 {
                    status = "okay";
};

Thanks,
we perform the change and now it seems ok.