No you cant just throw him out. You must use your states means for tenant removal. Now unless there is a lease he is a month to month tenant. This means either party can change tenancy terms with proper notice. Write him a notice to vacate. The time frame should be within your states guidlines...