My neighbour is building a kitchen extension and they want to temporarily remove part of my garden fence to give their builders more space to work.