This guy has some serious problems, and they are in his head.
What really nice guy would not trade places in a second!??
He was brought up in some phony macho baloney and/or with a really dominating woman somewhere along the line... mother perhaps.
And to accuse you of "cutting him off" is the real giveaway. Few men have the childhood training of respect and protection of ALL women, as it was in my generation. If this was the case, the last thing he would do is to make you feel guilty.
Control control control screams out here.
He needs to be taken out behind the barn and taught respect for GOD's greatest gift.