<commit_before><!DOCTYPE HTML>
<html>
<head>
	<meta charset="UTF-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">
	<title>Blog - Aika</title>
	<link rel="stylesheet" href="css/style.css" type="text/css">
	<link rel="shortcut icon" href="images/favicon.png" />

	<script>
		(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
					(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
				m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
		})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');

		ga('create', 'UA-77552310-1', 'auto');
		ga('send', 'pageview');

	</script>
</head>
<body>
<div id="header">
	<div>
		<div class="logo">
			<a href="index.html"></a>
		</div>
		<ul id="navigation">
			<li>
				<a href="index.html">Overall idea</a>
			</li>
			<li class="active">
				<a href="blog.html">Blog</a>
			</li>
			<li>
				<a href="inference.html">Inference</a>
			</li>
			<li>
				<a href="usage.html">Examples</a>
			</li>
			<li>
				<a href="resources.html">Resources</a>
			</li>
			<li>
				<a href="https://github.com/aika-algorithm/aika">GitHub</a>
			</li>
		</ul>
	</div>
</div>
	<div id="contents">
		<div class="features">
			<h1>Blog</h1>

			<h2>3. August 2019</h2>
			<b><a href="https://towardsdatascience.com/on-adding-negative-recurrent-synapses-to-a-neural-network-25a28409a6f2">On adding negative feedback synapses to a neural network</a></b><br/>
			<br/>
			<b>The missing link in deep neural networks</b><br/>
			<br/>
			The special thing about adding negative recurrent synapses to a neural network is that they introduce inner states within the network.
			...
			<br/><br/>
			<h2>9. December 2018</h2>
			<b><a href="https://towardsdatascience.com/on-integrating-symbolic-inference-into-deep-neural-networks-22ed13ebbba9">On integrating symbolic inference into deep neural networks</a></b><br/>
			<br/>
			<b>What makes biological neural networks so superior to their technical counterparts? Is there anything we have overlooked so far?</b><br/>
			<br/>
			Deep neural networks have been a tremendous success story over the last couple of years. Many advances in the field of AI, such as recognizing real world objects, fluently translating natural language or playing GO ...
			<br/><br/>
			<h2>25. October 2017</h2>
			<b><a href="https://data-science-blog.com/blog/2017/10/25/aika-ein-semantisches-neuronales-netzwerk/">Aika: Ein semantisches neuronales Netzwerk</a></b><br/><commit_msg>Blog entry<commit_after><!DOCTYPE HTML>
<html>
<head>
	<meta charset="UTF-8">
	<meta name="viewport" content="width=device-width, initial-scale=1.0">
	<title>Blog - Aika</title>
	<link rel="stylesheet" href="css/style.css" type="text/css">
	<link rel="shortcut icon" href="images/favicon.png" />

	<script>
		(function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
					(i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
				m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
		})(window,document,'script','https://www.google-analytics.com/analytics.js','ga');

		ga('create', 'UA-77552310-1', 'auto');
		ga('send', 'pageview');

	</script>
</head>
<body>
<div id="header">
	<div>
		<div class="logo">
			<a href="index.html"></a>
		</div>
		<ul id="navigation">
			<li>
				<a href="index.html">Overall idea</a>
			</li>
			<li class="active">
				<a href="blog.html">Blog</a>
			</li>
			<li>
				<a href="inference.html">Inference</a>
			</li>
			<li>
				<a href="usage.html">Examples</a>
			</li>
			<li>
				<a href="resources.html">Resources</a>
			</li>
			<li>
				<a href="https://github.com/aika-algorithm/aika">GitHub</a>
			</li>
		</ul>
	</div>
</div>
	<div id="contents">
		<div class="features">
			<h1>Blog</h1>

			<h2>9. August 2019</h2>
			<b><a href="https://medium.com/@lukasmolzberger/how-to-efficiently-propagate-activations-in-a-massive-neural-network-3faed60cb8f5">How to efficiently propagate activations in a massive neural network</a></b><br/>
			<br/>
			<b>An event-driven approach</b><br/>
			<br/>
			In traditional neural networks using the sigmoid activation function, all neurons are more or less activated. There is no clear case of an inactive neuron here.
			...
			<br/><br/>
			<h2>3. August 2019</h2>
			<b><a href="https://towardsdatascience.com/on-adding-negative-recurrent-synapses-to-a-neural-network-25a28409a6f2">On adding negative feedback synapses to a neural network</a></b><br/>
			<br/>
			<b>The missing link in deep neural networks</b><br/>
			<br/>
			The special thing about adding negative recurrent synapses to a neural network is that they introduce inner states within the network.
			...
			<br/><br/>
			<h2>9. December 2018</h2>
			<b><a href="https://towardsdatascience.com/on-integrating-symbolic-inference-into-deep-neural-networks-22ed13ebbba9">On integrating symbolic inference into deep neural networks</a></b><br/>
			<br/>
			<b>What makes biological neural networks so superior to their technical counterparts? Is there anything we have overlooked so far?</b><br/>
			<br/>
			Deep neural networks have been a tremendous success story over the last couple of years. Many advances in the field of AI, such as recognizing real world objects, fluently translating natural language or playing GO ...
			<br/><br/>
			<h2>25. October 2017</h2>
			<b><a href="https://data-science-blog.com/blog/2017/10/25/aika-ein-semantisches-neuronales-netzwerk/">Aika: Ein semantisches neuronales Netzwerk</a></b><br/>
{'fraction_non_alphanumeric': 0.18906889798824997, 'fraction_numerical': 0.023856150970268827, 'mean_word_length': 4.093381686310064, 'pattern_counts': {'":': 0, '<': 189, '<?xml version=': 0, '>': 189, 'https://': 11, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '2713181', 'n_tokens_mistral': 2364, 'n_tokens_neox': 2031, 'n_words': 446}