<commit_before><div class="mc-card md-whiteframe-z1">
	<md-toolbar layout="row" class="mc-header md-toolbar-tools">
		<h2>
	        <span>Documentation</span>
	    </h2>
    </md-toolbar>

	<md-content class="mc-table" layout="column">
		<!-- System -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /system</code>
			</div>
			<p flex class="mc-description">Returns a system report that covers <code>server-version</code>, <code>uptime</code>, <code>last-update</code>, <code>log-size</code>, <code>research-group-id</code> and <code>mendeley-api-status</code>.
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Statistics -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /statistics</code>
			</div>
			<p flex class="mc-description">
				Always returns the current number of profiles, publications and research fields.
				Additionally returns statistics based on the access logs that cover api calls, file downloads and BibTeX downloads of the last seven weeks in total and per week.
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Fields -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /fields</code>
			</div>
			<p flex class="mc-description">
				Returns all research fields that have been identified by the crawler.
				The crawler checks the tags that have been added to a Mendeley publication and merges small spelling variations.
				Thereby the original field name is reconstructed based on dash delimiters.
				(e.g. <code>cyber-physical-systems</code> becomes <code>Cyber Physical Systems</code>)
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Profiles -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /profiles</code>
			</div>
			<p flex class="mc-description">
				Given the optional parameters <code>profiles</code> and <code>fields</code>, returns all Mendeley Profiles that are associated with either a profile id OR a field id. The crawler only caches those profiles that belong to the configured Mendeley Research Group. If you do not pass any of these two parameters, all profiles (instead of none) are returned. If you pass the parameter <code>slim=true</code>, the result will only include <code>name</code>, <code>id</code> and <code>publication-count</code>.
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Publications -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /publications</code>
			</div>
			<p flex class="mc-description">
				Given the optional parameters <code>profiles</code> and <code>fields</code>, returns all publications that are associated with a profile id AND a field id.
				(e.g. <code>?profiles=1234125,1233125&fields=12534,12535</code> returns all publications of the users <code>1234125</code> and <code>1233125</code> that are associated with either the field <code>12534</code> OR the field <code>12535</code>)
			</p>
		</div>
	</md-content>
</div><commit_msg>Small text fix on documentation page<commit_after><div class="mc-card md-whiteframe-z1">
	<md-toolbar layout="row" class="mc-header md-toolbar-tools">
		<h2>
	        <span>Documentation</span>
	    </h2>
    </md-toolbar>

	<md-content class="mc-table" layout="column">
		<!-- System -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /system</code>
			</div>
			<p flex class="mc-description">Returns a system report that covers <code>server-version</code>, <code>uptime</code>, <code>last-update</code>, <code>log-size</code>, <code>research-group-id</code> and <code>mendeley-api-status</code>.
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Statistics -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /statistics</code>
			</div>
			<p flex class="mc-description">
				Always returns the current number of profiles, publications and research fields.
				Additionally returns statistics based on the access logs that cover api calls, file downloads and BibTeX downloads of the last seven weeks in total and per week.
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Fields -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /fields</code>
			</div>
			<p flex class="mc-description">
				Returns all research fields that have been identified by the crawler.
				The crawler checks the tags that have been added to a Mendeley publication and merges small spelling variations.
				Thereby the original field name is reconstructed based on dash delimiters.
				(e.g. <code>cyber-physical-systems</code> becomes <code>Cyber Physical Systems</code>)
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Profiles -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /profiles</code>
			</div>
			<p flex class="mc-description">
				Given the optional parameters <code>profiles</code> and <code>fields</code>, returns all Mendeley Profiles that are associated with either a profile id OR a field id. The crawler only caches those profiles that belong to the configured Mendeley Research Group. If you do not pass any of these two parameters, all profiles (instead of none) are returned. If you pass the parameter <code>slim=true</code>, the result will only include <code>name</code>, <code>id</code> and <code>publication-count</code>.
			</p>
		</div>
		<md-divider md-inset></md-divider>
		<!-- Publications -->
		<div class="mc-row" layout="row" layout-align="start center">
			<div class="mc-icon-text-column" flex="40" flex-align="start center" layout="row">
				<md-icon md-svg-icon="assets/svg/material-icons/ic_extension_black_24px.svg"></md-icon>
				<code flex>GET /publications</code>
			</div>
			<p flex class="mc-description">
				Given the optional parameters <code>profiles</code> and <code>fields</code>, returns all publications that are associated with a profile id AND a field id.
				(e.g. <code>?profiles=1234125,1233125&fields=12534,12535</code> returns all publications of the users <code>1234125</code> and <code>1233125</code> that are associated with either the field <code>12534</code> or the field <code>12535</code>)
			</p>
		</div>
	</md-content>
</div>
{'fraction_non_alphanumeric': 0.15650637384828978, 'fraction_numerical': 0.01792250410198157, 'mean_word_length': 4.172323759791123, 'pattern_counts': {'":': 0, '<': 233, '<?xml version=': 0, '>': 233, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 4, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5733936', 'n_tokens_mistral': 2873, 'n_tokens_neox': 2508, 'n_words': 700}