Since you are the Primary Residential Parent, it sounds as though you do have a custody order. However, if you don't, I think you should get one, and request the relocation. You have a valid reason.
Without a custody order and permission from the court, your wife can take the children from...