It's why we have body classifications like endomorph, mesomorph, and ectomorph.
The origins of these terms was actually psychology rather than physiology. The guy who came up with them did it in an attempt to correlate physiognomy with personality. Not a field that most people these days take terribly seriously. IIRC, he took thousands of photos of naked Yale students in order to further his research, too...
I know they're still popular terms for various reasons in weight training and in the popular press, but I wouldn't assign all that much significance to them, unless using them as a partial corollary of the more fundamental points I'll make about body shapes below:
Anyway,
Bluesteel is right on several points made upthread though they bear expanding:
1) Heavier people generally use more energy than lighter people. This is not difficult to understand. First of all, when moving, there's more mass to lug around; second, even when not moving, more mass means more oxidation required to support it remaining alive. Even fat tissue requires energy to stay alive, so the more of it you have, the more energy you burn through.
2) The caveat with the above is that it assumes the same ratio of muscle to fat between those people. If someone has a high ratio of muscle to fat, they'll burn through more calories because for any given mass of tissue, muscle requires more energy to support it than fat, even at rest. Conversely, someone with a high ratio of fat to muscle will burn through less calories than a high muscle ratio perosn of the same weight.
3) There is therefore person to person variation in BMR (how much energy you burn when perfectly at rest). The person's metabolism is not "slow" or "fast", in that each of their cells burns through much the same amount of energy as anybody else's. It's just that depending how much of and what kind of cells they have, their overall body will burn through more or less energy at rest. And since often (not always though) the different proportions of different tissues affects outward appearance of someone, it's easy to see how terms like mesomorph, etc, came about. To call this either a slow or fast metabolism is HIGHLY disingenuous, because that strongly implies - and is usually inferred as - an unchanging genetic feature they cannot alter, which is not true. It's not the shape or body appearance or cell metabolism that's the issue, those are just convenient (but sometimes inaccurate) proxies for underlying more fundamental issues. Put more bluntly, and barring a tiny minority of people with genuine underlying disorders, it's a convenient excuse.
By far, the most important thing if you just want to lose weight is how much you eat. Exercise is actually pretty inefficient for losing weight because you need to do a heck of lot of it to burn through enough calories, though it's obviously great for general health and for toning up and as a helping hand. But for weight loss, you need to control how much you're eating, overall.
And at the end of the day, no matter what you think your metabolism is, if you're taking in more calories than you're burning through, you will eventually put on weight; and if you're taking in fewer calories than you're burning through, you will eventually lose weight. It really, really isn't a difficult concept. The rate of loss or gain may not always be linear, mind you. People do tend to have weight plateaus (if you think about the competing variables that govern overall energy usage, you can easily see why) and other periods of more rapid loss/gain but that does not negate the statement.