Frankly I doubt it (athough it's a good story nevertheless). I
suspect it was used by sailors as a humorous expression just as it is
now, made all the more humorous by the fact that "brass monkeys" did
in fact exist aboard ship.

And some of them had balls. Look at the drawings of swivel mounted guns. :-)