One thing to note is that the 'original' (CGI actor) was already a bit awkward because things like the lip sync were off compared to a real actor.

That said, the facial animations for Leia in another video he made (they did a digital version of Leia for Rogue One, he deepfaked on top of that) actually improved with the deepfake version.