I have a secret, mystery man...?

He might be warning you to stay away from him because he feels offended of what you said about his pants. Pointing is very disrespectful, you know.