Yes. I imagine the last probe doing its last bit flip in the heat death of the universe. Then nothing can be computed anymore and all what will happen is the decay of the matter of the probe. So sad.

I get the feel that something like that was the plot of a short story i read ages ago.

The Last Question - http://multivax.com/last_question.html ?

Possibly qntm.