xfdesktop "Open With Other _Application..." changes default app regardless of the choice
With choice on xfdesktop "Open With" > "Open With Other _Application..." > sets default app regardless of the choice "Use by default for this filetype" checkbox.
May be it is a part of xfdesktop-file-icon-manager.c (I'm not sure)