The majority of employers do not look for a graduate to have studied at a particular university when hiring, a survey has suggested.