think of it like this.
1 dimensional is a line from Point A to Point B. you can only move in one direction because there's no room to turn around.
2 dimensional is a flat square. You can move around, but you can't move "up or down", which is kinda relative cause there is no up or down without gravity, but anyway.... We can see it but only if it isn't turned sideways.
3 dimensional..... well, here we are. up, down and all around. Height, width, depth. X, Y, Z axis. blah blah blah
I say all that to say that we're stuck only moving in a linear fashion time wise is because we aren't high up enough the dimensional scale to walk around in it. We can only move from Point A to Point B because time wise we're stuck on 1D, chronologically speaking. One step up we'd at least be able to move side to side, possibly backwards.
Sometimes our consciousness gets a bit of wiggle room and we experience dumb shyt like Deja Vu (doing what you already did) or we get the really good drugs and experience stuff slowed down, sped up or even out of chronological order.
Being that consciousness is another form of energy, and energy can't be destroyed, only moved or transformed. Energy exists everywhere and every when. We just happen to be stuck in these meat machines that can only filter reality on a 3d scale normally. We're like bugs trapped in amber.