Are you remarried and is there a stepfather willing to adopt? If not then the answer is NO.
Don't let him out of his child support obligation if you need it. However if you do not want him seeing the child and he doesn't want to see the child either, then filing for support may trigger some involvement on his part that you may not want.