Whether this is a crime or not depends on state law.
In California (and, I suspect MOST every state) this would NOT be the crime of kidnapping. Many/most states DO have criminal statutes for preventing visitation ... but, this usually requires a specific period of time to pass (approaching a couple of weeks, I suspect).
This is a prime example of why parents need to get custody and visitation papers after ANY split.
- Carl