I was just looking through some case law...
found a case dealing with a father who had voluntarily signed over custody to a grandparent, but later changed his mind.  You may be able to apply for modification of custody, based on material change in circumstances (moving into a nice house, for...