Annoyed.

I didn't say anything, doesn't mean I am fine with it?
Don't cross that line of limit.