<commit_before># CSV2CMI

## About

CSV2CMI is a little program to transform a table of letters (given as .csv) into the [CMI format](https://github.com/TEI-Correspondence-SIG/CMIF).
The CMI format is the underlying data format for the web service ‘[correspSearch](http://correspsearch.bbaw.de/)’ which facilitates searching across diverse distributed letter repositories.

It's intended for printed (print only) editions and catalogues of letters.

For now it is a rather stupid program:
* it assumes provided person ids are a [GND number from the German National Library](http://www.dnb.de/gnd)
* only a single date can be set

## Usage

You have to name your columns as follows:
* name of the sender: "sender"
* name of the addressee: "addressee"
* ids of the named person: "senderID" and "addresseeID"
* the date, when the letter has been sent: "senderDate"

You may provide places as additional information:
* where a letter has been sent: "senderPlace" (with the appropriate "senderPlaceID" as proper [GeoNames URL](http://www.geonames.org/))
* where a letter has been received: "addresseePlace" (with the appropriate "addresseePlaceID" as proper [GeoNames URL](http://www.geonames.org/))

If your letters are printed across different editions, add an "edition" column and put in there the bibliographic records. Numbering of letters should be stated in a additional column named "key". Alternatively you may enter in this column a link to the edited letter on the web.
If a date is put within brackets it sets @cert to 'medium', for persName and placeName alike @evidence is set.

*Check, that your table is using UTF8-encoding!*

## License

This program is available under [The MIT License (MIT)](https://opensource.org/licenses/MIT)<commit_msg>update for version 0.9.11<commit_after># CSV2CMI

## About

CSV2CMI is a little program to transform a table of letters (given as .csv) into the [CMI format](https://github.com/TEI-Correspondence-SIG/CMIF).
The CMI format is the underlying data format for the web service ‘[correspSearch](http://correspsearch.bbaw.de/)’ which facilitates searching across diverse distributed letter repositories.

It's intended for printed (print only) editions and catalogues of letters.

## Usage

You have to name your columns as follows:
* name of the sender: "sender"
* name of the addressee: "addressee"
* IDs of the named person: "senderID" and "addresseeID"
* the date, when the letter has been sent: "senderDate"

You may provide places as additional information:
* where a letter has been sent: "senderPlace" (with the appropriate "senderPlaceID" as proper [GeoNames URL](http://www.geonames.org/))
* where a letter has been received: "addresseePlace" (with the appropriate "addresseePlaceID" as proper [GeoNames URL](http://www.geonames.org/))

If your letters are printed across different editions, add an "edition" column and put in there the bibliographic records. Numbering of letters should be stated in a additional column named "key". Alternatively you may enter in this column a link to the edited letter on the web.
If a date is put within brackets it sets @cert to 'medium', for persName and placeName alike @evidence is set.

For sender and addressee IDs from the [GND](http://www.dnb.de/gnd) and the [VIAF](http://www.viaf.org/) are supported. 

For now only a single date can be set. 

*Check, that your table is using UTF8-encoding!*

## License

This program is available under [The MIT License (MIT)](https://opensource.org/licenses/MIT)
{'fraction_non_alphanumeric': 0.08537978298115363, 'fraction_numerical': 0.0028555111364934323, 'mean_word_length': 4.752052545155993, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 7, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '697022', 'n_tokens_mistral': 1001, 'n_tokens_neox': 963, 'n_words': 473}