There actually seem to be problems when the controller is not connected as "Player 1". My analog keyboard (WootingOne) was actually to blame because it is recognized as a controller. After I disconnected the keyboard and re-initiated the connection of the controller, it reconnected correctly and the game can be played normally.