<story><title>Show HN: Fast Real-Time Anomaly Detection in Dynamic Graphs</title><url>https://github.com/bhatiasiddharth/MIDAS/</url></story><parent_chain></parent_chain><comment><author>ugh123</author><text>The comments in this thread exhibit some serious astroturfing.  Also the 6 unique commenters accounts all created in the last 12 days.  Just sayin&amp;#x27;</text></comment>
<story><title>Show HN: Fast Real-Time Anomaly Detection in Dynamic Graphs</title><url>https://github.com/bhatiasiddharth/MIDAS/</url></story><parent_chain></parent_chain><comment><author>siddharthbhatia</author><text>Anomaly detection in graphs is a critical problem for finding suspicious behavior in innumerable systems, such as intrusion detection, fake ratings, and financial fraud. But most of the systems in place focus either on static graphs or on entire graph snapshots if they consider dynamic (time-evolving) graphs.&lt;p&gt;However, to minimize the effect of malicious activities and start recovery as soon as possible, we need to detect anomalies in real-time or near real-time i.e. to identify whether an incoming edge is anomalous or not, as soon as we receive it. In addition, since the number of vertices can increase as we process the stream of edges, we need an algorithm which uses constant memory in graph size. Moreover, fraudulent or anomalous events in many applications occur in microclusters or suddenly arriving groups of suspiciously similar edges e.g. denial of service attacks in network traffic data and lockstep behavior.&lt;p&gt;In this work, we propose MIDAS, which detects microcluster anomalies, or suddenly arriving groups of suspiciously similar edges, in edge streams, using constant time and memory. In addition, by using a principled hypothesis testing framework, MIDAS provides theoretical bounds on the false positive probability, which earlier methods do not provide. Also, we are up to 644 times faster and 48% more accurate than previous state of the art approaches.&lt;p&gt;For more details, read the paper at: &lt;a href=&quot;https:&amp;#x2F;&amp;#x2F;www.comp.nus.edu.sg&amp;#x2F;~sbhatia&amp;#x2F;assets&amp;#x2F;pdf&amp;#x2F;midas.pdf&quot; rel=&quot;nofollow&quot;&gt;https:&amp;#x2F;&amp;#x2F;www.comp.nus.edu.sg&amp;#x2F;~sbhatia&amp;#x2F;assets&amp;#x2F;pdf&amp;#x2F;midas.pdf&lt;/a&gt;&lt;p&gt;If you are in New York, you are welcome to attend the talk at AAAI in New York Hilton Midtown on 11th February at 2pm.</text></comment>