Why skivvies is slang for underwear is a little unclear, however, it was originally considered nautical slang.  An earlier skivvy/skivey was also used in London as a slang word for a “female domestic servant.”

In Iran, “female domestic servant” is slang for “wife.”