All perfect praise be to Allah, The Lord of the Worlds. I testify that there is none worthy of worship except Allah, and that Muhammad is His slave and Messenger.
There is no blame on you to stay away from your wife if she is satisfied, since she has the right to forgo having sex with you. But we remind you of your parents' and children's rights.
As for your parents, it is not permissible to travel without their full consent unless there is a dire need for travelling. As to your children, it is your duty to take care of them, to educate them, and to teach them the teachings of Islam.
Allah Says (what means): {O you who have believed, protect yourselves and your families from a Fire whose fuel is people and stones.} [Quran 66:6]
So, if there is someone who assumes their education, then there is no objection to travel. Otherwise, it is not permissible to leave them unless there is some dire need.
Allah knows best.