In addition to the idioms beginning with let someone, also see under let one let someone down let someone have it