Yes you can trim the limbs on your side of the fence/property. However it always makes sense to talk with your neighbor first. Ask them if they woud prefer to do it since it's their tree. If they refuse than let them know you will be trimming the limbs back (within reason) that are hazardous...