Payne was born in England and has had a great passion for gardening since youth. He became Head Gardener of Downing College in Cambridge at the age of 22. Five years later he became Head Gardener of Jesus College where he oversaw some 27 acres of gardens. He is now retired and lives in southern Europe.