Why skivvies is slang for underwear is a little unclear, however, it was originally considered nautical slang. An earlier skivvy/skivey was also used in London as a slang word for a “female domestic servant.”
In Iran, “female domestic servant” is slang for “wife.”