<commit_before>gson/
    - json -> golang (DONE)
    - golang -> json (TODO: use encoding/json:Marshal)
    - golang -> pointers (DONE)
    - json -> pointers (TODO: use json->golang->pointers)
    - golang pointer SET/DEL/GET (DONE)
    - json pointer SET/DEL/GET (TODO: use json->golang->golang-pointer)

cbor/
    - cbor -> golang (DONE)
    - golang -> cbor (DONE)
    - cbor -> json (DONE)
    - json -> cbor (DONE)
    - cbor -> pointers (DONE)
    - cbor pointer SET/DEL/GET (DONE)

collate/
    - golang -> collate (TODO)
    - collate -> golang (TODO)
    - json -> collate (TODO)
    - collate -> json (TODO)
    - cbor -> collate (TODO)
    - collate -> cbor (TODO)

schema/
    - TODO

patch/
    - TODO

Action items on gson/collate:

* codec.Encode() converts the input JSON to golang native before
  applying the encoding algorithm,<commit_msg>todo list.<commit_after>gson/
    - json -> golang (DONE)
    - golang -> json (TODO: use encoding/json:Marshal)
    - golang -> pointers (DONE)
    - json -> pointers (TODO: use json->golang->pointers)
    - golang pointer SET/DEL/GET (DONE)
    - json pointer SET/DEL/GET (TODO: use json->golang->golang-pointer)

cbor/
    - cbor -> golang (DONE)
    - golang -> cbor (DONE)
    - cbor -> json (DONE)
    - json -> cbor (DONE)
    - cbor -> pointers (DONE)
    - cbor pointer SET/DEL/GET (DONE)

collate/
    - golang -> collate (TODO)
    - collate -> golang (TODO)
    - json -> collate (TODO)
    - collate -> json (TODO)
    - cbor -> collate (TODO)
    - collate -> cbor (TODO)

schema/
    - TODO

patch/
    - TODO

- keep a track of scanString() that converts JSON string format to utf8
  format.
- there are three or more forms of scanString() document them clearly
  along with its configuration.
- Get() Set() Del() json-pointer operation on collated binary.

Action items on gson/collate:

* codec.Encode() converts the input JSON to golang native before
  applying the encoding algorithm,
{'fraction_non_alphanumeric': 0.13245033112582782, 'fraction_numerical': 0.0005094243504839531, 'mean_word_length': 2.374570446735395, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 41, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1228432', 'n_tokens_mistral': 711, 'n_tokens_neox': 683, 'n_words': 210}