<commit_before>Changelog
=========


1.5.9
-----
    - Fixed bug in marcxml.py.

1.5.0 - 1.5.8
-------------
    - Added more detections to convertor.py / toSemanticInfo().
    - marcxml.py changed and fixed. It can now convert MARC XML <-> OAI without any problems, just by changing .oai_marc property.
    - Fixed bug in ISBN submodule.
    - Added detection of ``ISBNQuery`` in ``ISBNValidationRequest``.
    - Updated setup.py to new version of dhtmlparser.
    - Fixed bug in deserialization of semanticinfo.
    - Added tracking of export progress.
    - Added new Query class - DocumentQuery.
    - Documentation cleaned.
    - Added documentation for convertor.
    - Fixed bug in unittests.
    - Queries to test base are now handled by OAI API, which has access.
    - Export is working.

1.4.5 - 1.4.9
-------------<commit_msg>Changelog updated to version 1.6.0.<commit_after>Changelog
=========

1.6.0
-----
    - Fixed bugs, old code, small improvements.
    - aleph.py: Added new function downloadRecords().
    - aleph.py: Added four new functions: getISBNsXML(), getAuthorsBooksXML(), getPublishersBooksXML() and getBooksTitleIDs().
    - aleph.py: Refactored few unnecessarily long variables.
    - convertor.py: Added new function getDocNumber().
    - __init__.py switched to use aleph.downloadRecord().
    - Fixed #27 - parsing of internal url field.
    - convertor.py refactored slightly, fixed few little bugs.

1.5.0 - 1.5.9
-------------
    - Fixed bug in marcxml.py.
    - Added more detections to convertor.py / toSemanticInfo().
    - marcxml.py changed and fixed. It can now convert MARC XML <-> OAI without any problems, just by changing .oai_marc property.
    - Fixed bug in ISBN submodule.
    - Added detection of ``ISBNQuery`` in ``ISBNValidationRequest``.
    - Updated setup.py to new version of dhtmlparser.
    - Fixed bug in deserialization of semanticinfo.
    - Added tracking of export progress.
    - Added new Query class - DocumentQuery.
    - Documentation cleaned.
    - Added documentation for convertor.
    - Fixed bug in unittests.
    - Queries to test base are now handled by OAI API, which has access.
    - Export is working.

1.4.5 - 1.4.9
-------------
{'fraction_non_alphanumeric': 0.11934900542495479, 'fraction_numerical': 0.015822784810126583, 'mean_word_length': 2.4740973312401886, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 4}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1111442', 'n_tokens_mistral': 698, 'n_tokens_neox': 646, 'n_words': 245}