That will not work. As soon as Apple stops signing 10.3.1, you won't be able to use it.
While installing a software, iTunes connects to Apple's servers, which make sure you don't try installing an iOS that's not signed. If you try this, you'll get an error. It won't be possible to proceed.