Bigger Humans?

How Come Humans Don't Just Keep Getting Bigger?

Some of us are tall, some of us short, some just average height. Clearly, save the occasional exception, our species seems to have hit a height, er, ceiling? What keeps us from being fee-fi-fo-fumming giants?