You need to have "configuration save on exit" and "configuration per core" both set to on.