It's not like this "previous identity" isn't almost always available in some way or another. Usually it's a bright shining red neon flag of uncanny-valley mismatch of physical features. But even in the best case scenarios there are subtle tells (e.g. google-image Christine McConnell - passes well but her face is still relatively masculine, and it's more obvious in the rare photos with other people).