Why our organs cannot simply be classified as male or female

Biological sex is usually described in simple binary terms: male or female. This works well for germ cells (sperm versus eggs), but for other body organs it is of little help.