If you ask me, sex isn't the most important thing to him. if your bf's biggest thing right now was having sex, either he would have left, or you would know because he would have tried to pressure you somehow. the fact that he doesn't says something!
now as a guy, if I was getting serious about settling down I would look for somebody who didn't consider sex to be a hugely important factor in a relationship. my reason being that sex can be something that can make or destroy a relationship very easily. it's hard to figure lust or love- I've been trying to figure that out for the last year and a half in my current relationship.
don't break things off to keep from feeling insecure.. feel secure because he stays with you, try to understand what is important to him, it sounds like you have already told him what is important to you, and its a good thing that he respects that.
make sure that you don't ever have sex before you are ready for it, sex can leave some of the biggest scars imaginable, scars that can last for your entire life....
if you should decide that you are ready for a sex life, then don't be afraid because he has had partners before.. thats only going to take away from the experience.. hell, honestly a lot of guys like virgins better!
hopefully that helped, good luck with everything!!