Yes, you can use Microsoft Bitlocker to encrypt a thumb drive, and then keep your most important secrets there. If you lose the key, you will lose access to the information. When you go to use the information, you will be decrypting the drive/data, and if you have security vulnerabilities, they can get to your data then.

It will protect you from random data loss, and I highly recommend it.

-John