Katz was born and raised in Brooklyn, New York. He holds a B.A. from Columbia and a Ph.D. in linguistics from the University of London. A former Gugenheim recipient, he has taught at Oxford and at Yale. He currently teaches at Vilnius University and is director of research at the Vilnius Yiddish Institute. He divides his time between Lithuania and North Wales.