The person is bluffing. He can't take the car if you tell him not to. Now if you leave it setting out where he can get at it, then it is fair game. However, as long as you are with the car he has no right to it without a Replevin order by the courts. So no matter how hard he tries to bluff you...