He would need to have your ok in order for him to take the baby out of state. He would need to file for visitations in your state unless the custody order was filed in the state he lives in. If that is the case he would be able to file in that state. If there has never been a custody order filed though the court then you will want to file where you are legally if you have not went though the court to get sole custody then you don't have it and then he would be able to file where he is and you would have to fly there. This gets differcult but until the court appoints custody to one of the parents neither parents have it.

