<commit_before>* Analysis
Analysis is a library that provides facilities to help analyze and
understand data. Listed below are the classes:

** Document
The document class represents a document. After creating a document,
you can perform several operations on it, some examples:

+ term count: how many times does a term appear in a document?
+ term frequency: how many times does a term appear divided by the
  total number of words in the document?

** Document Collection
The document collection class represents a collection of documents. As
with a document, there are several operations available, some examples:

+ dictionary: which words appear in the document collection?
+ keywords: what are the important keywords in this document
  collection?

** Document Vertex
The document vertex class represents a document that is part of a
graph. The edges slot of the document vertex class is used to store
edges of that particular vertex. The keys in the edges slot hash table
are the actual vertexes, and the values are the edge weights.<commit_msg>README.org: add documentation for document cluster class<commit_after>* Analysis
Analysis is a library that provides facilities to help analyze and
understand data. Listed below are the classes:

** Document
The document class represents a document. After creating a document,
you can perform several operations on it, some examples:

+ term count: how many times does a term appear in a document?
+ term frequency: how many times does a term appear divided by the
  total number of words in the document?

** Document Collection
The document collection class represents a collection of documents. As
with a document, there are several operations available, some examples:

+ dictionary: which words appear in the document collection?
+ keywords: what are the important keywords in this document
  collection?

** Document Vertex
The document vertex class represents a document that is part of a
graph. The edges slot of the document vertex class is used to store
edges of that particular vertex. The keys in the edges slot hash table
are the actual vertexes, and the values are the edge weights.

** Document Cluster
The document cluster class represents a document that is part of a
graph which will be clustered. It extends the documenet-vertex class
and adds support for a cluster tag and a list of neighbors. These
slots are useful for clustering algorithms.
{'fraction_non_alphanumeric': 0.033112582781456956, 'fraction_numerical': 0.0, 'mean_word_length': 4.713947990543735, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5911643', 'n_tokens_mistral': 531, 'n_tokens_neox': 523, 'n_words': 372}