Unintended selection in Side Pane

Version information

4.20

Steps to reproduce

1. With Devices in the Side Pane, I "Unmount" a disk via right-click menu. Then usually there is no visibly selected element in the Side Pane.
2. In the main area (a tab with an open folder), there can be some file selected. I press "key up" or "key down" to select the next or the previous file in the folder.

Current behavior

A disk that was just unmounted, gets mounted again, and selected in the Side Panel.

Expected outcome

The selection should go to a file in the main area.

Comment

I wouldn't mind to disable keyboard navigation in the Side Pane at all, as I don't use it anyway. Perhaps there could be such an option in Preferences or something? Otherwise, I want Side Pane to get no keyboard focus at all, unless a user specifically navigates there.