xfce4-screensaver-command --lock keeps failing to show dialog and launches screensaver repeatedly

Originally pointed this out on How to fix XFCE's xflock4 reapeatedly launching the screensaver?

When running xfce4-screensaver-command --lock which is used by xflock4, it fails to show the password prompt (while moving mouse cursor or pressing any key) and keeps turning the screen back to the screensaver animation until it finally gets to show the dialog after some fails.

Found these logs when this happen:

2023-09-19T23:46:43.388158-03:00 NuttyUbuntuPC kernel: [  193.276117] traps: xfce4-screensav[4332] general protection fault ip:561eb084eef1 sp:7fff0ece3220 error:0 in xfce4-screensaver-dialog[561eb0844000+e000]
2023-09-19T23:46:45.236148-03:00 NuttyUbuntuPC kernel: [  195.124196] traps: xfce4-screensav[4367] general protection fault ip:55872ee50ef1 sp:7ffd177ff870 error:0 in xfce4-screensaver-dialog[55872ee46000+e000]
2023-09-19T23:46:46.972160-03:00 NuttyUbuntuPC kernel: [  196.860823] traps: xfce4-screensav[4401] general protection fault ip:5580dce26ef1 sp:7ffee02b7a50 error:0 in xfce4-screensaver-dialog[5580dce1c000+e000]
2023-09-19T23:46:48.144157-03:00 NuttyUbuntuPC kernel: [  198.032189] traps: xfce4-screensav[4432] general protection fault ip:558817cfeef1 sp:7ffdce7fdfb0 error:0 in xfce4-screensaver-dialog[558817cf4000+e000]
2023-09-19T23:46:49.248148-03:00 NuttyUbuntuPC kernel: [  199.138527] traps: xfce4-screensav[4466] general protection fault ip:55f17be07ef1 sp:7fff85a6cfa0 error:0 in xfce4-screensaver-dialog[55f17bdfd000+e000]
2023-09-19T23:46:53.224176-03:00 NuttyUbuntuPC kernel: [  203.112682] traps: xfce4-screensav[4497] general protection fault ip:563c7d60cef1 sp:7fff0c7405b0 error:0 in xfce4-screensaver-dialog[563c7d602000+e000]
2023-09-19T23:46:54.164162-03:00 NuttyUbuntuPC kernel: [  204.053417] traps: xfce4-screensav[4527] general protection fault ip:55e94c516ef1 sp:7fff2ae1e130 error:0 in xfce4-screensaver-dialog[55e94c50c000+e000]
2023-09-19T23:46:55.640630-03:00 NuttyUbuntuPC kernel: [  205.528433] traps: xfce4-screensav[4558] general protection fault ip:559c4692def1 sp:7ffee6381df0 error:0 in xfce4-screensaver-dialog[559c46923000+e000]
2023-09-19T23:46:57.268161-03:00 NuttyUbuntuPC kernel: [  207.156902] traps: xfce4-screensav[4589] general protection fault ip:55f6d054cef1 sp:7ffc3df5dd70 error:0 in xfce4-screensaver-dialog[55f6d0542000+e000]
2023-09-19T23:47:03.440185-03:00 NuttyUbuntuPC kernel: [  213.331467] traps: xfce4-screensav[4629] general protection fault ip:55ee16540ef1 sp:7ffe40694240 error:0 in xfce4-screensaver-dialog[55ee16536000+e000]
2023-09-19T23:47:05.528250-03:00 NuttyUbuntuPC kernel: [  215.418363] traps: xfce4-screensav[4664] general protection fault ip:5637e4b9eef1 sp:7fffb3326310 error:0 in xfce4-screensaver-dialog[5637e4b94000+e000]
2023-09-19T23:47:08.144206-03:00 NuttyUbuntuPC kernel: [  218.035214] traps: xfce4-screensav[4699] general protection fault ip:55991f816ef1 sp:7ffca013ada0 error:0 in xfce4-screensaver-dialog[55991f80c000+e000]
2023-09-19T23:47:09.044158-03:00 NuttyUbuntuPC kernel: [  218.935055] traps: xfce4-screensav[4732] general protection fault ip:55e726701ef1 sp:7ffd85f664b0 error:0 in xfce4-screensaver-dialog[55e7266f7000+e000]
2023-09-19T23:47:10.492150-03:00 NuttyUbuntuPC kernel: [  220.382446] traps: xfce4-screensav[4767] general protection fault ip:5573e2b30ef1 sp:7ffcdbbe7480 error:0 in xfce4-screensaver-dialog[5573e2b26000+e000]
2023-09-19T23:47:13.464151-03:00 NuttyUbuntuPC kernel: [  223.355329] traps: xfce4-screensav[4802] general protection fault ip:55771c7efef1 sp:7ffdfc788b30 error:0 in xfce4-screensaver-dialog[55771c7e5000+e000]
2023-09-19T23:47:14.128236-03:00 NuttyUbuntuPC kernel: [  224.017081] traps: xfce4-screensav[4832] general protection fault ip:5576a691fef1 sp:7ffde0512100 error:0 in xfce4-screensaver-dialog[5576a6915000+e000]
2023-09-19T23:47:14.788162-03:00 NuttyUbuntuPC kernel: [  224.678027] traps: xfce4-screensav[4863] general protection fault ip:55efde79eef1 sp:7ffcaf3993a0 error:0 in xfce4-screensaver-dialog[55efde794000+e000]
2023-09-19T23:47:16.676164-03:00 NuttyUbuntuPC kernel: [  226.565708] traps: xfce4-screensav[4894] general protection fault ip:5647a487def1 sp:7fffcbfdde80 error:0 in xfce4-screensaver-dialog[5647a4873000+e000]