For me the main difference was that the PS4 versions car had what appeared to be dirt on the side skirts of the car where as the XB1 didn't lol.

I didn't notice that but it's perhaps a prime example of things being removed from the XB1, rather than things being added to the PS4.

I don't think the XB1 will suffer greatly on multiplats to be fair, although if the rumours of ambient occlusion not being possible with it are true, later down the line there may be some less subtle differences.

To be fair, I doubt it will look much better than GTAV in terms of graphical detail. The fidelity will be instantly noticeable though and that's where compressed web video misleads people. What will be interesting is if and when they bring out a next gen version built from the ground up. Will they be able to achieve all of the AI and interactivity AND improve the graphical detail?

Right now there is nothing out there that comes close to the fidelity of infamous second Son, but that has been accused of being close to a ghost town. Whether or not that is down to commercial timescales or the competence of the hardware may not become apparent with the current wave of releases.

Will go through the video again and see if I can notice these differences

I noticed that XB1 drivers have worse eyesight than PS4 drivers, if this bus shelter is anything to go by...

And interestingly:

On closer inspection the Xbox One version seems to have vibrant colors and better black, the PS4 on the other seems to have the perfect balance and better anti-aliasing.

LMAO, going by the few people I've watched on twitch it's not so much the drivers but the physics and handling of the car that's the issue, pretty much everyone seemed to say the handling of the cars was awful. I've seen someone crash into a car head on which only slowed the guy down he got out of the car and it wasn't even damaged one bit, also saw him do about a 40ft jump in another car crash straight into a parked car which almost flipped him and again he got out and not a scratch on the car again, yet later on he nicks a sign post and his rear side of his car grinds along a wall and his car almost explodes, hopefully they will sort stuff like this out though.

Hope this isn't Battlefield 4 and a patch a week scenario