Face2Face: Real-time Face Capture and Reenactment of RGB Videos (CVPR 2016 Oral)

Yea, perhaps. Like in the recent "face2face: realtime face capture and re-enactment video"[1]. and your reference to "your avatar" reminds me of the scene from the matrix where Morpheus describes "residual self-image"[2] [1] [VIDEO] [2] [LINK]

I find it amusing that they're touting it for an application where I find it quite likely that similar NN algorithms will excel at generating speech in someone else's voice. (c.f., "neural style transfer" in images, but applied to speech.) We're already getting pretty decent at this for video -- see, for example, [VIDEO] (Face2Face: Real-time Face Capture and Reenactment)

The consumer use cases are interesting but the propagandist use cases are terrifying. Along with this (Real-time Face Capture and Reenactment): [VIDEO]

OK, throw this into the mix: many of you reading this have smartphones which are voice controlled, and for which voice control is activated at all times. In the case of Google, that processing must take place on Google's centralised servers. Siri may or may not do centralised processing (and can operate in standalone modes). Microsoft's Cortana, Facebook's "M" (IIRC) and Amazon's Aero are all various stylings of "Stasi in a Glade form factor", as Maciej Czeglowski so memorably put it.[1] Voice stores distressingly cheaply in terms of space, and with the Internet of (broken) Things (that spy on you), odds of finding yourself surrounded by microphones in the most unexpected locations,[2] controlled by a wide variety of quite probably competing interests.[3] And if they cannot find what they're looking for in the surveillance tape itself, they'll simply manufacture their own evidence using your own phonemes[4] and video.[5] ________________________________ Notes: 1. [LINK] 2. [LINK] 3. [LINK] 4. [LINK] 5. [VIDEO]

It gets even better when combined with Face2Face, a live-editing software that can transfer facial expressions including lip movements from actors to e.g. politicians on TV: [VIDEO]

Maybe CG will be good enough to keep casting dead actors? The face2face[1] tech looks pretty convincing to me and it already works in real-time (which isn't necessary for films) and you have plenty of old footage of them. [1] [VIDEO]

I still think that it is incredibly important that we make tools for validation of primary source material easy to use and friendly for non-technical people. Tech for faking video is getting more powerful day by day. [LINK] [VIDEO]

> "Fake News" is about to get a lot more compelling hen you can make anyone say anything as long as you have some previous recordings of their voice. Adobe has already developed that technology: [LINK] Now imagine combining it with this: Face2Face: Real-time Face Capture and Reenactment of RGB Videos [VIDEO] Perhaps using the intonation from the face-actor's voice to guide the speech synthesis.