sourcemap: avoid hysteresis from mouse hover

When the mouse is hovered over the sourcemap, we would get into a situation
where it would just collapse/expand over and over again. This tracks if
we are in the map and ensures stability during that time.

https://bugzilla.gnome.org/show_bug.cgi?id=779971