Found the problem thanks to the jstest tool.
The default state of the buttons was ON because of bad wiring on the switches.
I connected the TOP pin and the LOWER pin. It is supposed to be the TOP pin and the MIDDLE pin, in contrary to what the drawing shows on the switch.
For reference, this is CORRECT connection:
And this was the WRONG connection: