I've recently been battling my candida very aggressively too, and my adrenals really seem to be suffering a lot.
I do think the die off is causing a huge strain on my body, and my adrenal fatigue has got significantly worse. I am hoping that as the effects of my recent treatment for candida subsides that I will recover my strength. I don't have any answers but just wanted to let you know that I've had the same experience. With diet changes and candistroy I felt bad for a few weeks each time. I've recently taken lufenuron which has caused a lot more die off, and I'm 2 weeks in so hopefully another week or so will see improvement. Hopefully as you just give it a little more time you'll get your energy back. Hope that helps.