@nikoel have you buy an Original N64 Controller or an N64 USB replica? What do you mean with you can't configure it? Does the Controller Work but you don't know how to map the Buttons or does the Controller do not Work?

Have you look into the Manual?

https://recalbox.gitbook.io/documentation/tutorials/controllers/configuring-custom-buttons/n64-controllers-configuration