As per above, anybody can sue anybody for anything. They have the right to sue you. They will not win.
I have no idea why the HOA would sue you. That sounds like a very bizarre course of action for them to take, and if they did, they wouldn't have any legal grounds I know of for doing so...