So you’re booting from what is on the USB stick, it’s acting as a little hard drive that your machine is loading the OS from. Then the is running on the system installs it’s self to the actual hard drive. That installer build of the OS is still on the USB stick. What is on the hard drive might be different as during installation and set up, it may have been configured differently. But the USB stick should be unchanged.