Multiple workspace groups probably don't work well on wayland

The problem has been reported for the pager in xfce4-panel, but I guess the cause is (also) here, since it's never been tested I think.