Scheduling conflicts and Training self-learners in CM

I believe strongly in independent learning, yet I also LOVE the SCM options for a Charlotte Mason learning environment. Here’s the catch. I took my 6th grade son out of a curriculum that was working for him in all the LA areas, put him in SCM’s Spelling Wisdom, Using Language Well, and the recommended Analytical Grammar. AG and SW are taking so much of my time in order for him to complete his days, and since he basically does ULW orally, this takes my time as well. I have two younger students who are pre-readers, or just above pre-reader level, who have to have me there for ALL their work, as well as a 4 year old and a 2 year old. The need for me to now be working more with my 6th grader has been an unexpected stress on our homeschool days and on my already full schedule and limited physical strength. While I love these resources I am now wondering if I need to just let this older guy work on his own in what was already working and leave the “ideals” of CM for right now.
Does anyone have any ideas on how to use a CM approach that does allow for more student driven work, and less of my input in the LA arena??