@stoppedwumm That's going to be very difficult to achieve. Recalbox runs on a very minimal stripped-down Linux with only the very basic tools available. So you can't just install extra software with apt.
You could in theory download the source for OpenVPN and compile it yourself, but you would probably find a lot of dependencies missing.