<story><title>Stablevideo: Text-driven consistency-aware diffusion video editing</title><url>https://rese1f.github.io/StableVideo/</url></story><parent_chain></parent_chain><comment><author>lhl</author><text>Also recently released is &amp;quot;CoDeF: Content Deformation Fields for Temporally Consistent Video Processing&amp;quot; &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;qiuyu96.github.io&amp;#x2F;CoDeF&amp;#x2F;&quot; rel=&quot;nofollow noreferrer&quot;&gt;https:&amp;#x2F;&amp;#x2F;qiuyu96.github.io&amp;#x2F;CoDeF&amp;#x2F;&lt;/a&gt;&lt;p&gt;&amp;quot;We present the content deformation field (CoDeF) as a new type of video representation, which consists of a canonical content field aggregating the static contents in the entire video and a temporal deformation field recording the transformations from the canonical image (i.e., rendered from the canonical content field) to each individual frame along the time axis. Given a target video, these two fields are jointly optimized to reconstruct it through a carefully tailored rendering pipeline. We advisedly introduce some regularizations into the optimization process, urging the canonical content field to inherit semantics (e.g., the object shape) from the video.&amp;quot;&lt;p&gt;The results also look very stable&amp;#x2F;impressive.</text></comment>
<story><title>Stablevideo: Text-driven consistency-aware diffusion video editing</title><url>https://rese1f.github.io/StableVideo/</url></story><parent_chain></parent_chain><comment><author>runeks</author><text>It&amp;#x27;s fun to watch how it blends together videos, but none of the three example videos are actually of high enough quality to be useful.&lt;p&gt;1. The boat video transforms the coast into rolling waves and looks super weird&lt;p&gt;2. The swan&amp;#x2F;duck video looks better than the others, but the lighting is obviously wrong when looking closer. Looks like a cardboard cutout bird.&lt;p&gt;3. The car video looks like a video game from the 2000s, with low quality textures and wheels not turning.&lt;p&gt;Again, super interesting to see how it can come up with these &amp;quot;by itself&amp;quot;, but utterly useless at the moment.</text></comment>