Detract, as in Her straggly hair takes away from her otherwise attractive appearance. [Second half of 1800s]