Taylor spent most of his youth in Cleveland, Ohio. Every summer his family would enjoy a month with his great aunt, Ann Brown, in the family home by the post office in Beaufort, before the days of air conditioning and ever present streetlights. The University of North Carolina at Chapel Hill gave Taylor his formal education, but summers still belonged to Beaufort.