This thesis describes a set of related experiments and computational studies concerned with the recognition of human affect from visually observable behavior. The work is aimed at improving the understanding of the relationship between emotion and external behavior as well as providing a basis for the development of potentially beneficial technology.