You really can’t go wrong with Boy of the Pyramids. Your library is unlikely to have it, but it is worth getting.
Some things that might be easier to find–The Golden Goblet is still very good. And it’s pretty available–if your library does not have it, it is currently available on Paperbackswap.com, and on Amazon for a penny plus shipping.
We really liked Senefer: A Young Genius in Old Egypt, by Beatrice Lumpkin, and The Riddle of the Rosetta Stone (very possibly there is a Rosetta STone book in your library, even if not this one)
If you do not object to learning about mummies (can’t really avoid learning some false religious practices there, but there are lots of ways to discuss this) then Mummies of Ancient Egypt by Aliki is pretty available.
We loved Bethlehem Books’ Young Hawk by Andre Norton; you could try that at your library.
Pyramid by David McCauley is really widely available in libraries and would make a good ILL candidate. It’s also available on Amazon for about a dollar plus shipping.
There is a good book about a little Hebrew girl who leaves Egypt with the Exodus; we loved it, but I can’t find it and I’m having a middle-age moment and can’t remember the title. We really liked it though! Hopefully someone sharper can help.
We have a book called The Egyptian News that was a lot of fun, and we picked it up at bookcloseouts.com for very little once. I don’t know how available it still is. It’s like a “newspaper” with stories and ads.
Then just look at what your library DOES have. Mine has several books we used. One warning–many of the heavily illustrated books, like the Usborne type books and the knock-offs of them, have very immodestly dressed women in their Egypt books. This was not right for our family so we left those on the shelf.