Stacking It ' s a pretty cute , novel concept . And the actual game is . ?<| sep |> Just got rektd . People keeping screaming that they want the internet to be a utility until people treat it like one then they say it ' s not fair . This is exactly the kind of crap you have to deal with every utility bill . You wanted it , now you have it . stop complaining . <| sep |> Welp , take it how you will , but that ' s not how neural nets work . They are trained on a dataset , given a new dataset of the same type , and work with the same inputs on which they were trained . In this case that is both audio and video as made explicit by the article you cite . Unless the unspecified author has a citation to back up the phrase by only looking at the lips , I would attribute that phrase to a lack of understanding on the author ' s part . I would not extrapolate from that phrase that no audio was incorporated . Further , I believe the conclusion you draw is a false assumption , as it simply does not fit with how neural networks operate . Source CS MajorExTvQ . Edit I do not disagree that this is a lip reading machine it clearly is , I am disputing the inputs required for it provide the illusion of reading lips . Edit # 2 To emphasize from my original citation of your citation The problem was that the audio and video streams were sometimes out of sync by almost a second , which would have made it impossible for the AI to learn associations between the words said and the way the speaker moved their lips .