Sure you have a problem. How could even consider living with anyone that is on any kind of drugs is beyond me, as it will destroy his life, and yours too if you stay. If i knew my partner was on drugs i would run and run quickly and move on until i find someone who is not on drugs and is opposed to them.
Personally i take this same approach with alcohol, drugs and smoking. I would not want anything that would effect my health let alone my relationship with someone i hope to care about.