This is true but the OP implies that this is a matter of the other guy either going out of HIS way, or of random encounters.
I avoid dozens of people.
It is very easy to be reclusive, for example.
In a larger city, one can avoid running into someone for years.
Besides, if a miscreant is determined to perpetrate crimes against your person, a pretty piece of legal paper offers you no protections.
Beyond the pretty paper, there are pretty laws that are supposed to prohibit robbery, burglary, murder, rape, etc...
The prisons are proof that laws alone are incapable of protecting innocents.
Avoidance works for me, if it doesn't eliminate the problem, Sam Colt's little invention is another great equalizer among humankind.