A bowel movement once every 4 days is not good enough. Look into a high carb low fat vegan diet. Dr. John Mcdougall has a good book. Eat a lot of ripe fruit too. Diet change really helped my BM's and my dry skin.
As for your boss and people noticing it, try not to be embarrassed and just tell them the truth, that you are having some health problems that are difficult to manage. They should understand. Keep your head up.