Because when people talk about "having a man" they mean a relationship. If you're single and out sowing your wild oats you don't have "a man", you have a sex life. It's a wee bit silly to insert yourself into conversations where you don't recognise the terminology.