a hard/tough nut (to crack)

a person or thing that is difficult to deal with, understand, or influence