Knight was born in rural Mississippi and received little formal education. He served as an army-trained medical technician during the Korean War and was badly wounded. Later he was convicted of armed robbery and spend six years in prison. He has been awarded fellowships by the Guggenheim Foundation and the National Endowment for the Arts, and in 1985 received the Shelley Memorial Award from the Poetry Society of America.