Nope.
Even if he doesn't pay child support, that doesn't remove his rights as the father and the State will let him be a lousy father for the most part.
Quick question though - because this will probably impact you way more than the kids' situation - the mortgage. Who is on the deed? Is...