Work and matter

Me and friend were talking about work.

Friend: Don't disturb me with instant messages. Not all are lucky like you to get big salary and chat at work.

Me: But I work when it matters. You work or don't work it doesn't matter. Putting it in another way, I think there is probably no matter in your work.