Maybe he tried to get close to a female on one or two or more occassions, but every time he tried, all he could think of was his sister humping him. Maybe that created a repulsion that stopped him from ever being able to be with any female, since it made him think of you every time.