I see no reason to opt for something like leather or wool - which of course carry the same environmental issues of food from those animals.

because not everything can be made from a single thing–if we could just do that none of this would be an issue to begin with. leather is conducive to some things wool is not, and cotton likewise, and ad infinitum. these aren’t interchangeable for every purpose that exists!