Different view modes are all set to same zoom level

Currently I can only set the zoom level sensibly for one view mode at a time, and every time I change the view mode, I have to adjust the zoom level as well. So typically I can either zoom in and have sensibly sized icons in Icon View:

...which are oversized in Compact and List view:

Or I can zoom out, and have undersized icons in Icon View:

..but sensibly sized for the other views:

Occasionally, if I am lucky, I will boot into some kind of default setting which, while still not ideal, does manage to at least have slightly different sized icons between the different view modes:

However, as soon as I manually change the zoom level, I can no longer return to that state again, even after a reboot. It seems to return on its own eventually, but I'm not sure how/why. Perhaps it requires a system update.

If I set the zoom level to 'Normal Size', it will set a reasonable zoom level in each case (except for excess padding in Icon View as already reported here), but has to be re-applied every time you change view mode.

Ideally each view mode would remember its last used zoom level independently of the others, so they could each be set according to the user's own preference.

If anyone knows a way to make the 'Normal Size' zoom setting also get triggered when you change the view mode, that would be a helpful mitigation in the meantime. But maybe that would first require a solution to adjusting keybindings as discussed here.