I made the switch from AoKL to Hoto with my summoner a couple months ago, and I can't see myself ever going back to AoKL. You get so many more benefits from Hoto, and assuming you have good +skills from your equipment, the few extra points from AoKL aren't going to give you a huge advantage on the margin.
My current setup is to use Hoto as my main weapon, and when my army is engaged and I'm safely behind them, I switch over to a Beast axe to help them kill even faster. I suppose CTA could be another good choice for your switch, but with enough meat shields you barely get hit anyway.
Oh, and the Oak Sage charges are really a non-factor in this decision. Oak Sages have a really annoying habit of flying right up in front of enemies and getting themselves one-hit, so they never last long.
Basically I'm holding Hoto 90% of the time. But yeah, when I'm safely behind my minions (like a quarterback, you could say), that's when I pull out my Beast and let them hack away. I also morph into a Werebear when we're up against bosses so I can get in a few Crushing Blows and speed things up. It's a lot more fun than standing around casting Decrepify whenever it wears off.