From the name of a public house in the area, named after Thomas Trench Berney who owned the Reedham Cement Works centred on the Berney Arms Windmill.
Berney Arms