Sometimes I can't remember which component is which. The only way to do that is by placing the component into the canvas, see if it's the one. If it's not the one I'm looking for, I'll delete and place another one. Even with good naming system, I still think it is a better way to have a visual preview of the component just like Webflow did with the library.
I love this idea very much! Make the component library similar to the asset library in this way.
Agreed, and also if you're working with clients, it would add that little "extra" for them.