I speak from the other perspective...
Our Swiss neighbours have one (we are also in a row house) and it seems like open house for all the kids in the village. Now I love kids but as a neighbour you can only take so much of kids screaming. As long as you can agree about some timing I dont see a problem - no Sundays for example. We had occasions of a succession of kids all day on a Saturday from morn till night. This was too much and we asked them to limit it to certain times. It was simply impossible to sit in the garden with the noise. It needs co-operation dont assume your neighbours love your kids like you do!
all the best