All perfect praise be to Allaah, The Lord of the Worlds. I testify that there is none worthy of worship except Allaah, and that Muhammad is His slave and Messenger. We ask Allaah to exalt his mention as well as that of his family and all his companions.
The scholars often advise the spouses to be patient over the misconduct or misbehaviour of one towards the other in order to reconcile between them and so that marital life would continue rather than divorce taking place. In most cases divorce is of a greater harm. However, many spouses realize this after they had divorced, especially if they had children who suffered from this divorce. So the scholars look to the objectives of the Islamic Law and do not favour one spouse over the other. Scholars may sometimes rule that divorce is better when marital life has become very bad and when a husband or wife can no longer bear the hardship of staying with the other. What has been said applies as well to your husband in relation to you as he is unjust between you and the first wife in relation to providing for you and spending the night with you. If this is the case, then your husband has committed a sin even if his intention was to be just amongst yourselves. If the means of reconciliation are of no avail then you have to be wise in balancing between the benefit of staying with him and the benefit of asking divorce from him as a way of repelling the harm from you.
Allaah Knows best.