I don't know about cayenne pepper, but just adding a drop of Oil of Oregano to my oil swishing has irritated the inside of my mouth terribly. I don't know if that the way it's going to be or if the inside of my mouth just needs to adjust.
So, I would think if your mouth isn't used to cayenne, you will have some irritations, too.