It’s fine as an adjective. Female and male are used to modify the noun, usually when discussing animals. It’s incorrect to use it as a noun, especially when a perfectly serviceable one exists already: women. You may well have had the best of intentions using it and have just fallen foul of the fact that lots of men use it to be derogatory and dismissive towards women. Just something to bear in mind.