Is the term sir/monsieur only used to address men?

Yes ... Except Marcie addressing Peppermint Patty :)

Pretty much ! Some young men are called that also but it's mainly for adult males.