I was curious and google smarty pants says... = No, they are not all in the same family; Black Locust and Honey Locust are in the legume family (Fabaceae), while Mulberry is in its own family (Moraceae), and Osage Orange is also related to Mulberry (Moraceae) but often grouped with them due to shared characteristics, though Black Locust/Honey Locust (Legumes) are quite different from Mulberry/Osage (Fig/Mulberry family).
I would have just said there is a maniac running around (buZZsaw BRAD ) cutting down every Black Locust he can find. Just a matter of time before they are completely wiped out.