manager: Fix keyboard leak when recreating windows

Gaël Bonithonrequested to merge
Tamaranch/xfce4-screensaver:issue-187 into master

Fixes: #187 (closed) Completes: 6e178d38

Merge request reports