<commit_before>---
layout: post
title: Metadata Histogram
image: "https://github.com/SotiriosVrachas/metadata-histogram/raw/master/cgi.jpg"
published: true
---

A seven day laptop usage physical profile. What can the timestamps alone of the metadata that I generating simply by using a computer reveal about me?

<!-- more -->

![Metadata Histogram/CGI](https://github.com/SotiriosVrachas/metadata-histogram/raw/master/cgi.jpg "Metadata Histogram/CGI")

## Documentation
ABS used: 51g

Printing time: ~4 Hr.

Software Stack: Debian GNU/Linux, FreeCAD, LibreOffice Calc, Inkscape, Blender
(for CGI)

### How it was done

```
sudo zcat /var/log/syslog.7.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.6.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.5.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.4.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.3.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.2.gz | awk -F':' '{print $1}' >> log
sudo awk -F':' '{print $1}' /var/log/syslog.1 >> log
sudo awk -F':' '{print $1}' /var/log/syslog >> log

uniq -c log > logfreq
```
Then logfreq > chart.ods > data formating > chart.svg > lines to closed paths > waves.svg > waves.fcstd > extrude paths > wave*.stl

## Wanted features
Day 1 and 2 are missing the activity that happen around 23:00 due to shorter
data ranges in calc.

Shorter process.

Commands for other log types. Git and Thunderbird store similar metadata
but for a longer period of time.

There is a 15 minute gap at day 7 around the time that I captured the data. I added the rest of the data for that day afterwards and added an estimated value to that slot. My logs start at 8:00 every day so I had to capture data twice to get a full dataset.

## License
[Metadata Histogram](http://www.vrachas.com/metadata-histogram) by [<NAME>](http://www.vrachas.com/) is licensed under a [Creative Commons Attribution-ShareAlike 4.0 International License](https://creativecommons.org/licenses/by-sa/4.0/).

## Inspiration
"I search, therefore I am" Workshop with [Kyriaki Goni](http://kyriakigoni.com)
<commit_msg>Update 2017-02-06-metadata-histogram.md<commit_after>---
layout: post
title: Metadata Histogram
image: "https://github.com/SotiriosVrachas/metadata-histogram/raw/master/cgi.jpg"
published: true
---

A seven day laptop usage physical profile. What can the timestamps alone of the metadata that I generating simply by using a computer reveal about me?

<!-- more -->

![Metadata Histogram/CGI](https://github.com/SotiriosVrachas/metadata-histogram/raw/master/cgi.jpg "Metadata Histogram/CGI")

Source: https://github.com/SotiriosVrachas/metadata-histogram/

## Documentation
ABS used: 51g

Printing time: ~4 Hr.

Software Stack: Debian GNU/Linux, FreeCAD, LibreOffice Calc, Inkscape, Blender
(for CGI)

### How it was done

```
sudo zcat /var/log/syslog.7.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.6.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.5.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.4.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.3.gz | awk -F':' '{print $1}' >> log
sudo zcat /var/log/syslog.2.gz | awk -F':' '{print $1}' >> log
sudo awk -F':' '{print $1}' /var/log/syslog.1 >> log
sudo awk -F':' '{print $1}' /var/log/syslog >> log

uniq -c log > logfreq
```
Then logfreq > chart.ods > data formating > chart.svg > lines to closed paths > waves.svg > waves.fcstd > extrude paths > wave*.stl

## Wanted features
Day 1 and 2 are missing the activity that happen around 23:00 due to shorter
data ranges in calc.

Shorter process.

Commands for other log types. Git and Thunderbird store similar metadata
but for a longer period of time.

There is a 15 minute gap at day 7 around the time that I captured the data. I added the rest of the data for that day afterwards and added an estimated value to that slot. My logs start at 8:00 every day so I had to capture data twice to get a full dataset.

## License
[Metadata Histogram](http://www.vrachas.com/metadata-histogram) by [<NAME>](http://www.vrachas.com/) is licensed under a [Creative Commons Attribution-ShareAlike 4.0 International License](https://creativecommons.org/licenses/by-sa/4.0/).

## Inspiration
"I search, therefore I am" Workshop with [Kyriaki Goni](http://kyriakigoni.com)

{'fraction_non_alphanumeric': 0.1372639336711193, 'fraction_numerical': 0.017503454629203132, 'mean_word_length': 3.9184597961494902, 'pattern_counts': {'":': 0, '<': 7, '<?xml version=': 0, '>': 57, 'https://': 7, 'lorem ipsum': 0, 'www.': 4, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5093517', 'n_tokens_mistral': 1521, 'n_tokens_neox': 1430, 'n_words': 535}