Using panchromatic imaging from some of the largest and deepest space-based galaxy surveys, an empirical census of galaxy structure is made for galaxies at different cosmic epochs and in environments spanning low to extremely high galaxy number densities.