<commit_before>+++
title = "LogParser"
+++
## Introduction
This is a User Defined Function for [LogParser](https://github.com/nielsbasjes/logparser/)

## Getting the UDF
You can get the prebuilt UDF from [maven central](https://search.maven.org/remotecontent?filepath=nl/basjes/parse/useragent/yauaa-logparser/{{%YauaaVersion%}}/yauaa-logparser-{{%YauaaVersion%}}-udf.jar).

If you use a maven based project simply add this dependency

```xml
<dependency>
  <groupId>nl.basjes.parse.useragent</groupId>
  <artifactId>yauaa-logparser</artifactId>
  <classifier>udf</classifier>
  <version>{{%YauaaVersion%}}</version>
</dependency>
```

## Client hints
Because the logparser can only dissect a _single_ field into multiple pieces it is impossible to extend this to support User-Agent Client Hints.

## Example usage



<commit_msg>docs: Cleanup<commit_after>+++
title = "LogParser"
+++
## Introduction
This is a User Defined Function for [LogParser](https://github.com/nielsbasjes/logparser/)

## Getting the UDF
You can get the prebuilt UDF from [maven central](https://search.maven.org/remotecontent?filepath=nl/basjes/parse/useragent/yauaa-logparser/{{%YauaaVersion%}}/yauaa-logparser-{{%YauaaVersion%}}-udf.jar).

If you use a maven based project simply add this dependency

```xml
<dependency>
  <groupId>nl.basjes.parse.useragent</groupId>
  <artifactId>yauaa-logparser</artifactId>
  <classifier>udf</classifier>
  <version>{{%YauaaVersion%}}</version>
</dependency>
```

## Client hints
Because the logparser can only dissect a _single_ field into multiple pieces it is impossible to extend this to support User-Agent Client Hints.
{'fraction_non_alphanumeric': 0.1336996336996337, 'fraction_numerical': 0.0, 'mean_word_length': 5.662601626016261, 'pattern_counts': {'":': 0, '<': 23, '<?xml version=': 0, '>': 23, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 2}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5986229', 'n_tokens_mistral': 555, 'n_tokens_neox': 514, 'n_words': 137}