<commit_before>Line format 3 for libnetmon:

<Command>: <Key> <Timestamp> <Value>

<Command> describes the kind of connection
<Key> is a unique key for the connection
<Timestamp> is a decimal number representing absolute time
<Value> is a command-dependent string

Possible commands and their values:

New (value is 'TCP' or 'UDP')
RemoteIP (value is a dotted quadruplet describing destination IP address)
RemotePort (value is a number representing the remote port of the connection)
LocalPort (value is a number representing the local port of the connection)
TCP_NODELAY (int)
TCP_MAXSEG (int)
SO_RCVBUF (int)
SO_SNDBUF (int)
Connected (no value) (RemoteIP and RemotePort MUST be sent before this command)
Write (value is the size of the write or sendto)
Closed (no value)
<commit_msg>Added a SendTo command for UDP. Added sequencing information.<commit_after>Line format 3 for libnetmon:

<Command>: <Key> <Timestamp> <Value>

<Command> describes the kind of connection
<Key> is a unique key for the connection
<Timestamp> is a decimal number representing absolute time
<Value> is a command-dependent string

Possible commands and their values:

New (value is 'TCP' or 'UDP')
RemoteIP (value is a dotted quadruplet describing destination IP address)
RemotePort (value is a number representing the remote port of the connection)
LocalPort (value is a number representing the local port of the connection)
TCP_NODELAY (int)
TCP_MAXSEG (int)
SO_RCVBUF (int)
SO_SNDBUF (int)
Connected (no value) (RemoteIP and RemotePort MUST be sent before this command)
Write (value is the size of the write or sendto)
SendTo (value is <localPort>:<remoteIP>:<remotePort>:<size>
Closed (no value)

On a TCP connection, there should be the following sequence:

New
(TCP_NODELAY|TCP_MAXSEG|SO_RCVBUF|SO_SNDBUF|RemoteIP|RemotePort)*
Connected
LocalPort
Write*
Closed

On a UDP connection, there should be the following sequence:

New
(SO_RCVBUF|SO_SNDBUF)*
SendTo*
Closed
{'fraction_non_alphanumeric': 0.06868272680676576, 'fraction_numerical': 0.0010251153254741158, 'mean_word_length': 5.825174825174825, 'pattern_counts': {'":': 0, '<': 23, '<?xml version=': 0, '>': 23, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '7233134', 'n_tokens_mistral': 581, 'n_tokens_neox': 562, 'n_words': 270}