Fatal: Crashes very often when .desktop files are refreshed

When I add a new .desktop file or change any, that triggers the XFCE desktop to refresh the icons, I often see this:

A few times I clicked "remove" by mistake and that nuked the entire dock. I had to add it again and pin again all of my apps + do all of the tweaks. I noticed this more with multiple screens and multiple panels. Maybe since I have 2 docklike, 1 on my main screen, 1 on my external monitor, it refreshes both and it detects that it refreshed more than once for the past 60 seconds. Maybe that's the cause?

And why is it not ok to restart more than once every 60 seconds?