<commit_before>Missing pieces:

- fix long text index entries (for new general sort order)
  * ???
- implement foreign key index creation & relationship creation
  * MEDIUM
- implement table creation w/ complex columns
  * MEDIUM
- implement (optional) foreign key enforcement
  * MEDIUM
- implement write support for properties
  * EASY
- implement table, column, index renaming
  * EASY
- implement table, column, index deletion
  * EASY - MEDIUM
- implement more comprehensive unicode compression write support
  * EASY? (have the code, do we trust it?)
- implement createReadOnlyTemp(InputStream) (delete temp file on close)
  * EASY
- figure out how msaccess manages page/row locks
  * MEDIUM

Refactor goals:
- simplify public API (separate "internal" and "external" api)
* separate table creation objects from existing metadata objects
* remove "simple" index support?
* remove "table traversal methods" from Table?
* enable integrity by default?
* remove import/export methods from Database?
* move database open/create options to DBBuilder
* tweak how import filters work to make them more flexible?
- tweak lookup apis (specify column vs column name)
* separate classes into more packages (api,builder,util,impl)
* remove debug log blocks
* add Row interface
* change savepoint to use table number instead of name?
* don't use columnimpl for creating tables
  * clean up columnimpl/tableimpl constructors
* add updateCurrentRow(Map), add updateRow(Row)
* sort out query types
- clean up javadocs
  - enhance public api classes
  - add @usage tags to util classes
* add unit tests for Row update/delete methods, add/update *FromMap methods
* add reason to unsupop throws for indexes
* remove static methods in CursorImpl/IndexCursorImpl
* create ComplexValue.Id and keep RowId
* remove DatabaseImpl from util classes
- remove unnecessary iterator class from impl classes? (what does this mean?)
* change CodecHandler usage to handle not-inline decoding
  - pass filename to CodecHandler, enable pwd callbacks CallbackHandler
  - pass custom context to CodecHandler?
  - rework CryptCodecProvider to have custom
    javax.security.auth.callback.CallbackHandler which is only invoked if
    password is definitely required.
* rework attachment data handling
- implement page buffering in PageChannel
  * need to implement logical flushing in update code (startUpdate/finishUpdate)
* limit size of IndexPageCache?
* make non-thread-safeness more explicit
- refactor free-space handlers Table/Column?
* update index/cookbook for new api
* add basic walk-through in class javadocs to guide users to correct classes
  and basic getting started stuff.
- implement "lazy" usage maps (load on first usage)?
- implement some OLE support

* public api final cleanup:
  * Database

- changes
  - simple index support gone
  - foreign key constraints enforced by default
  - "main" classes became interfaces
  - advanced API functionality still remains in impl classes
  - all new instance construction via builders
  - iterable methods went away, iterable builder
  - util classes moved to util package
  - Row is now an interface
  
<commit_msg>cleanup todo list post 2.0 release<commit_after>Missing pieces:

- fix long text index entries (for new general sort order)
  * ???
- implement foreign key index creation & relationship creation
  * MEDIUM
- implement table creation w/ complex columns
  * MEDIUM
- implement (optional) foreign key enforcement
  * MEDIUM
- implement write support for properties
  * EASY
- implement table, column, index renaming
  * EASY
- implement table, column, index deletion
  * EASY - MEDIUM
- implement more comprehensive unicode compression write support
  * EASY? (have the code, do we trust it?)
- implement createReadOnlyTemp(InputStream) (delete temp file on close)
  * EASY
- figure out how msaccess manages page/row locks
  * MEDIUM

Refactor goals:
- tweak lookup apis (specify column vs column name)
- clean up javadocs
  - enhance public api classes
  - add @usage tags to util classes
* change CodecHandler usage to handle not-inline decoding
  - pass filename to CodecHandler, enable pwd callbacks CallbackHandler
  - pass custom context to CodecHandler?
  - rework CryptCodecProvider to have custom
    javax.security.auth.callback.CallbackHandler which is only invoked if
    password is definitely required.
- implement page buffering in PageChannel
  * need to implement logical flushing in update code (startUpdate/finishUpdate)
- refactor free-space handlers Table/Column?
- implement "lazy" usage maps (load on first usage)?
- implement some OLE support
- add typed getter methods to Row

{'fraction_non_alphanumeric': 0.055591467356173235, 'fraction_numerical': 0.00043094160741219563, 'mean_word_length': 4.239277652370204, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1574524', 'n_tokens_mistral': 1211, 'n_tokens_neox': 1178, 'n_words': 572}