I feel the same. I wrote about it a few years ago now:

https://medium.com/p/321bb06e0c39

I feel a bit of a fraud when people talk about their reasons for being childfree. I never had a reason, it's just never something I wanted.