Good thoughts here. I'm glad you mentioned Libby at the end because in my experience that is by far the biggest advantage of having a Kindle.
There are three main things I care about with books: the experience of handling them and looking at the covers or spines on the bookshelf (advantage: physical books), the experience of reading them (advantage Kindle Paperwhite), and the ability to reference them for research (slight advantage physical--they both score points in different ways on this front).
Based on that, you would think that I prefer physical books since they come out ahead in 2 of 3 categories, but it turns out that the category the Kindle wins is the most important to me. I still like both formats, but I do most of my reading on a Kindle