As phrased, it's a physical impossibility (unless his house is also underground).
Assuming you meant "on his property," instead of "on his house," there certainly won't be a law against it. Whether it violates any agreement between the four of you is, of course, impossible for anyone here to...