Here's the thing: you were planning on leaving minors alone overnight 3 nights a week, with a neighbor being somewhat "on call". Once in a while is one thing, but close to half the time is problematic.
As angry as you are, you have to realize that her concerns are not completely unreasonable...