All perfect praise be to Allah, The Lord of the Worlds. I testify that there is none worthy of worship except Allah, and that Muhammad is His slave and Messenger.
If the woman is non-Muslim and is not from the People of the Book then you should immediately separate from her. Being with her is pure Zina; we ask Allah to protect us.
It she is from the People of the Book (Christian or Jew) and she is chaste, then you may continue your life with her.
We even advise you not to divorce her. Probably the divorce will cause harm to your child and he may become far from the true religion.
Allah knows best.