When a man has a lot on his mind, does he want to be left alone?

hubby lost his job couple of months ago, lately he's withdrawn, he doesn't say much and the more i try to bring him close the more he pushes me away, i did say to him few times some things i shouldn't have said regarding money and him not taking care of things, i know he must feel awful, how can i fix this?