Flat Networks Inevitably Fall Flat