I kinda like how in old-school turn-based RPGs, sometimes you'd be able to read about 50-60 books in a library, but your character would basically open it up and skim it for some tidbit. Usually it would be something informative about a creature, or place in the world, or some hint as to the location of some ruins, etc.
This was overly simplified, as these were much simpler games, but I think it wouldn't be preposterous to be able to read many, many books in a book-lined room, but have most of them only provide small glints of information. Think of it like a Skill check. "Your character read through this book for an hour, and this is what they managed to find that was of any use or relevance to anything that they know of."
I agree completely would be a great way to do it!