Scroll wheel scrolls windows not lines

Xfce 4.14 Fedora 33

If you grab the mouse too hard, throwing it off the active window, then roll the middle mouse roller, Xfce activates the window that the mouse is now accidentally over and you start scrolling lines on that windows instead of the windows that was previously active. It is really, really ANNOYING! Please fix!

Many thanks, -T