<story><title>Fake celebrity porn is blowing up on Reddit, thanks to artificial intelligence</title><url>https://www.theverge.com/2018/1/24/16929148/fake-celebrity-porn-ai-deepfake-face-swapping-artificial-intelligence-reddit</url></story><parent_chain><item><author>bduerst</author><text>What&amp;#x27;s to keep you from adding the key to a camera after falsely generating the media?  Or using the key of a known camera to generate false footage?</text></item><item><author>BoiledCabbage</author><text>&amp;gt; What do you mean &amp;quot;authentication technology&amp;quot;?&lt;p&gt;Cryptographic signatures. Ie every frame in a video is signed with a 512-bit key that states authoritatively what camera was the source of the video and when it was taken. In order to change any pixels in the video you&amp;#x27;d break this key and need to resign it. An attacker would be unable to do this unless they had physical access to the original camera.&lt;p&gt;But it&amp;#x27;ll be at least 3 decades before this technology is commercialized, people see the demand for it, and the majority of all cameras in the world are replaced by it.
Even if this new tech is on the market in a decade (simple tech, no demand &amp;#x2F; ecosystem yet), but 90% of existing &amp;#x2F; installed cameras don&amp;#x27;t have the feature then fake videos still get created with them. Only once ~80% of videos are authenticated, and a significant portion of the remaining 20% are fakes will people be able to dismiss non authenticated video. Up until then it&amp;#x27;s fakes non-stop.&lt;p&gt;We&amp;#x27;ve got some ugly decades coming up.</text></item><item><author>unethical_ban</author><text>What do you mean &amp;quot;authentication technology&amp;quot;? Tamper detection? The ability to see that a tool was used? It may slow things down, but this is an arms race.</text></item><item><author>Chaebixi</author><text>I wouldn&amp;#x27;t be that pessimistic just yet.  It&amp;#x27;s yet possible that new advances in authentication technology might counteract some of these trends.</text></item><item><author>hirundo</author><text>Technology is degrading the value of photo and video evidence (and probably audio too) asymptotically toward that of famously unreliable testimony from memory.  Criminality becomes less risky and&amp;#x2F;or innocence becomes less protective. Law becomes less effective. A bad result, to the extent that the law isn&amp;#x27;t an ass.&lt;p&gt;On the plus side artistic tools that help materialize internal life become more effective. We can interact with our dreams and fantasies more readily, to potentially therapeutic benefit.&lt;p&gt;It&amp;#x27;s hard to say whether this trend holds more danger or promise.</text></item></parent_chain><comment><author>BoiledCabbage</author><text>So spitballing, my assumption is that it&amp;#x27;d end up looking something like SSL certificate chains today.  In the situation you mentioned:&lt;p&gt;1. The attacker wouldn&amp;#x27;t have access to the original cameras private key.
2. The attacker creates a fake video, creates a private key and signs the video with the key
3. The attacker tries to install the key into a camera&lt;p&gt;Step 3 has to be made impossible. Meaning that a camera becomes a trusted entity and only allowed parties (ex the camera manufacturer) has the authority to insert a private key into a camera. This would be that after installing a camera with a new private key, the key would then need to be signed with the manufacturer&amp;#x27;s private key and also stored in the camera. This shows the manufacturer is responsible for the contents of the video. If someone tries to change the camera&amp;#x27;s private key it would no longer match what the manufacturer signed.&lt;p&gt;Which yes then means we need to have authorized camera manufactures and a process for certificate revocation and all of that.&lt;p&gt;The exact opposite of &amp;quot;free and open&amp;quot; for recording devices - and the only way we aren&amp;#x27;t flooded with fake videos flooding and seriously impacting society. We have to want this if we want to still have a concept of video evidence in either the justice or social spheres.</text></comment>
<story><title>Fake celebrity porn is blowing up on Reddit, thanks to artificial intelligence</title><url>https://www.theverge.com/2018/1/24/16929148/fake-celebrity-porn-ai-deepfake-face-swapping-artificial-intelligence-reddit</url></story><parent_chain><item><author>bduerst</author><text>What&amp;#x27;s to keep you from adding the key to a camera after falsely generating the media?  Or using the key of a known camera to generate false footage?</text></item><item><author>BoiledCabbage</author><text>&amp;gt; What do you mean &amp;quot;authentication technology&amp;quot;?&lt;p&gt;Cryptographic signatures. Ie every frame in a video is signed with a 512-bit key that states authoritatively what camera was the source of the video and when it was taken. In order to change any pixels in the video you&amp;#x27;d break this key and need to resign it. An attacker would be unable to do this unless they had physical access to the original camera.&lt;p&gt;But it&amp;#x27;ll be at least 3 decades before this technology is commercialized, people see the demand for it, and the majority of all cameras in the world are replaced by it.
Even if this new tech is on the market in a decade (simple tech, no demand &amp;#x2F; ecosystem yet), but 90% of existing &amp;#x2F; installed cameras don&amp;#x27;t have the feature then fake videos still get created with them. Only once ~80% of videos are authenticated, and a significant portion of the remaining 20% are fakes will people be able to dismiss non authenticated video. Up until then it&amp;#x27;s fakes non-stop.&lt;p&gt;We&amp;#x27;ve got some ugly decades coming up.</text></item><item><author>unethical_ban</author><text>What do you mean &amp;quot;authentication technology&amp;quot;? Tamper detection? The ability to see that a tool was used? It may slow things down, but this is an arms race.</text></item><item><author>Chaebixi</author><text>I wouldn&amp;#x27;t be that pessimistic just yet.  It&amp;#x27;s yet possible that new advances in authentication technology might counteract some of these trends.</text></item><item><author>hirundo</author><text>Technology is degrading the value of photo and video evidence (and probably audio too) asymptotically toward that of famously unreliable testimony from memory.  Criminality becomes less risky and&amp;#x2F;or innocence becomes less protective. Law becomes less effective. A bad result, to the extent that the law isn&amp;#x27;t an ass.&lt;p&gt;On the plus side artistic tools that help materialize internal life become more effective. We can interact with our dreams and fantasies more readily, to potentially therapeutic benefit.&lt;p&gt;It&amp;#x27;s hard to say whether this trend holds more danger or promise.</text></item></parent_chain><comment><author>andrewstuart2</author><text>Require that videos submitted as evidence use keypairs which were provably registered or published prior to the event.&lt;p&gt;Don&amp;#x27;t have a registered key? Great, but that&amp;#x27;s no longer admissible.&lt;p&gt;Still, problems would exist with letting the camera read the private key for signing, but not allowing an attacker (forger) to access the private key and thus sign their modified footage.&lt;p&gt;Just a thought.</text></comment>