Four years is a long time with no contact. If you didn't provide any support for the children, that may count against you. Also, if you never attempted to get custody through the courts, then that may count against you as well. Truthfully, the grandparents may be able to argue that you abandoned...