Libxfce4ui >= 4.19.4 can be built without X11 support and therefore whithout XfceSMClient.
mentioned in commit c3c7a9ec