Hmm..
What is it that the ex signed? Something more significant than a note?
He can't simply give up his rights to the child without court action.
He can change his mind at any time up until your current husband has legal guardianship awarded by the court.