keyboard: Make sure the XKB group in use is always what we want

The layout we want is always in the first XKB group index so we should
enforce it to make sure we never end up with the wrong one.

https://bugzilla.gnome.org/show_bug.cgi?id=696996