<commit_before>#+TITLE:     GNUGOLD FAQ
#+AUTHOR:    <NAME>
#+EMAIL:     d at taht.net
#+DATE:      <2010-12-20 Tu>
#+LANGUAGE:  en
#+TEXT:      Searching the Web over persistent protocols
#+OPTIONS:   H:1 num:nil todo:nil toc:t \n:nil @:t ::t |:t ^:t -:t f:t *:t TeX:t LaTeX:nil skip:nil d:nil tags:not-in-toc
#+INFOJS_OPT: view:nil toc:t ltoc:t mouse:underline buttons:0 path:org-info.js
#+LINK_UP: index.html
#+LINK_HOME:
#+STYLE:    <link rel="stylesheet" type="text/css" href="worg.css" />
#+STYLE:    <script type="text/javascript" src="org-info.js"> 
* Why is it called GNUGOLD?
  The name is a play on several words - Canoodle, google, gnu, and I am in search of "New Gold" - what designing a custom protocol for client distributed search...
* What will it do?
  Act as a proxy query router using udp or sctp to more well connected search sites.
* How does it work? 
- Simple searches easily fit into a single packet
- Most responses - when cleared of extra stuff - are less than 16K
- Persistent connections have no setup or teardown time
- DNS lookups done at the center of the internet are fast
- Short distance http connections on well connected networks are much faster than long distance connections over flaky networks. 
* How much does it cost? 
  It's currently free. It's my hope that something like this could become an internet standard for search. There are numerous options for paid search that I'm looking into. 
** Selling rights to the "default" search engine
   Mozilla does this with google
** Dual-licensing the code under the GNU AFFERO public license
** Paid secure searching (crypted)
** Wave hands and say that search inevitably must become a commodity. 
* Use Cases
** Scenario: OLPC - A teacher and 20 students 
A teacher prepares a lesson plan using internet resources and gnugold. In her (well-connected) home, she does her queries using the gnugol plugin, which downloads and keeps organized her data set, collecting the bits of data that she will use to teach the lesson. She then goes to the school for the lesson. Her students, while receiving the lesson, also do queries, many of which the teacher has already asked, and are cached on her laptop, and thus are presented immediately to the kids without the need for external network access.

See also: [[file:trust.org][Trust relationships]].<commit_msg>continued painful attempt at making the doc match the input2<commit_after>#+TITLE:     GNUGOLD FAQ
#+AUTHOR:    <NAME>
#+EMAIL:     d at taht.net
#+DATE:      <2010-12-20 Tu>
#+LANGUAGE:  en
#+TEXT:      Searching the Web over persistent protocols
#+OPTIONS:   H:1 num:nil todo:nil toc:t \n:nil @:t ::t |:t ^:t -:t f:t *:t TeX:t LaTeX:nil skip:nil d:nil tags:not-in-toc
#+INFOJS_OPT: view:nil toc:t ltoc:t mouse:underline buttons:0 path:org-info.js
#+LINK_UP: index.html
#+LINK_HOME:
#+STYLE:    <link rel="stylesheet" type="text/css" href="worg.css" />
#+STYLE:    <script type="text/javascript" src="org-info.js"> 
* Why is it called GNUGOLD?
  The name is a play on several words - Canoodle, google, gnu, and I am in search of "New Gold" while designing a custom protocol for client distributed search...
* What will it do?
  Act as a proxy query router using udp or sctp to more well connected search sites.
* How does it work? 
- Simple searches easily fit into a single packet
- Most responses - when cleared of extra stuff - are less than 16K
- Persistent connections have no setup or teardown time
- DNS lookups done at the center of the internet are fast
- Short distance http connections on well connected networks are much faster than long distance connections over flaky networks. 
* How much does it cost? 
  It's currently free. It's my hope that something like this could become an internet standard for search. There are numerous options for paid search that I'm looking into. 
** Selling rights to the "default" search engine
   Mozilla does this with google
** Dual-licensing the code under the GNU AFFERO public license
** Paid secure searching (crypted)
** Wave hands and say that search inevitably must become a commodity. 
* Use Cases
** Scenario: OLPC - A teacher and 20 students 
A teacher prepares a lesson plan using internet resources and gnugold. In her (well-connected) home, she does her queries using the gnugol plugin, which downloads and keeps organized her data set, collecting the bits of data that she will use to teach the lesson. She then goes to the school for the lesson. Her students, while receiving the lesson, also do queries, many of which the teacher has already asked, and are cached on her laptop, and thus are presented immediately to the kids without the need for external network access.

See also: [[file:trust.org][Trust relationships]].
{'fraction_non_alphanumeric': 0.07710181664554289, 'fraction_numerical': 0.00612589776087875, 'mean_word_length': 4.169213973799127, 'pattern_counts': {'":': 0, '<': 11, '<?xml version=': 0, '>': 11, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '4576299', 'n_tokens_mistral': 1399, 'n_tokens_neox': 1327, 'n_words': 696}