If The Sun Went Out, How Long Could Life On Earth Survive?

If you put a steamy cup of coffee in the refrigerator, it wouldn't immediately turn cold. Likewise, if the sun simply 'turned off' (which is actually physically impossible), the Earth would stay warm - at least compared with the space surrounding it - for a few million years. But we surface dwellers would feel the chill much sooner than that.