I'm answering before I read the other answers to your question so I don't know if my answer is going to line up with what others say, but here goes.
What makes cattle fat before the slaughter . . . grains. What feeds yeast (a parasite) . . . grains and many other carbos.
There are those few out there that believe we are not supposed to eat grains, but rather meats and vegetables with very limited if any carbs. I started to adhere to a diet very close to this but, unfortunatly like you I started back on a few old favorites and found myself craving them all the more. I hope to go back to the carb limited diet again with the new year.
Here is a place you can go to research the grain free diet: http://www.mercola.com he even sells an online grain free cookbook if you think it would be impossible to cook this way. Just type in the search "grain" you'll find a whole slew of articles to read.
So long story short, I think that you could go on a diet of just meat, vegetables and some fruits and be just fine.