Holly and Ivy! Not a chapter book per se, but long enough that it should be, since it takes multiple readings to finish.
Also- there is a Little House Christmas Treasury that we read most years. Each chapter is one of the Christmas chapters from the various books in the series.
Jotham’s Journey is good. It has a chapter and devotion for each night of advent. We read it with lit Advent candles and my DC would take turns blowing out the candles.
Every year, we read The Father Christmas Letters by Tolkein aloud to our family. My dh reads one every night. It is a tradition that everyone looks forward to, no matter how young or old.
eta — Rereading your post, I see you are looking for chapter books. I’m not sure if this one would fit the bill or not, but it is terrific.
Good for you for thinking ahead on the Christmas books. You have reminded me to reserve a few at the library in the coming weeks so we will have them on hand. Here is a post on my blog listing some Christmas picture books you guys might enjoy: