It goes further. People with hard work and few meals tend to assimilate foods better, and to develop thiner, more dense muscles (same difference as marathonians and sprinters, or climbers and body-builders).
So in time of privation people used to hard work with few calories (mountainers, peasants of barren regions) have a few less strength but much better resilience than more massive people accustomed to more generous ration.