How single stars lost their companions