They may live in the lap of luxury, but life isn’t always perfect for the women who reside in one of the wealthiest enclaves of the U.S.