The AI-off switch

Could an AI misbehave in such a way that we have to switch it off, only to find out that we cannot? If the answer to this theoretical exercise is …