I highly, highly recommend buying a copy of Andreas Moritz 's books 'The Amazing Liver & Gallbladder Flush'.
He explains in detail how liver congestion causes adrenal fatigue, and all the other symptoms you are experiencing.
On one side, you don't want to aggravate the problem by doing a flush, but on the other, you want to eliminate the root cause so the problem goes away,
That's a decision you will have to make on your own, but an educated choice only will come from having a full understanding by reading the liver and gallbladder flush book.
I find that so many doctors and even naturopaths just treat the symptoms of adrenal fatigue. When the bile ducts are blocked, hormones that are suppose to exit these ducts aren't able to and just keep recirculating and accumulating in the bloodstream, causing a huge host of issues, including adrenal issues. Because estrogen is responsible for regulating sodium and water retention, as that accumulates in the blood, swelling of the glands takes place as well.