Xfdesktop assumes single-workspace-mode = TRUE, so we need to do the same when setting wallpapers in Thunar. Thanks to ToZ for finding this.