build: Properly guard wayland code

Gaël Bonithonrequested to merge
Tamaranch/xfce4-terminal:issue-383 into master

Closes: #383 (closed) Fixes: ab0136ac

Merge request reports