Where the milliseconds actually go.
Frame time, not frame rate: an average hides the one frame in sixty that took four times as long, and that is the one you feel.