I do not in any way mean this nastily. Please do not take it as anything but an attempt to be helpful.
If he's got you this nervous when even you admit that he's unlikely to do anything that can harm you, perhaps a session or two with a mental health counselor might be worthwhile. Talking the whole thing out with a professional can be useful.
I don't take offense. I do see someone and I will bring this up. I've just never experienced anything like this and don't know. I already know I'm an anxious person in general. I'm not denying it. And I appreciate all of your reassurance and responses. I will get past this as time goes on and I see that nothing happens from it.