<jupyter_start><jupyter_text>Now that the bot chooses what to use from the past interactions/turns, we need to assess the current input and the previous state (if the case) in order to know the current state of the conversation. For each of these states we will have further policies that will help us in the NOG layer. Possible states:•	Discourse – with 3 levels of advisory depending on the importance; •	Dialogue – with 3 levels of Q&As depending on the importance;•	Diatribe – chit chat;•	Debate – art of conversation with controlled policies;•	User Queries – with 2 categories (commercial chatbot (1) & deep conversational through book queries (2));•	Bot Queries – with 2 categories (virtual assistant/forms (1) & AGI with intuition (2));•	Special policies – with four categories (the user is giving a review (1) & the bot is asking for a review (2) no action (3), no reaction (4)).<jupyter_code># IN: current NIU + past states
# OUT: an identified state
# insert code for:
# Assessing the current state of the conversation;
# Additional/Confirmation questions are not influencing the states;
# In the current NIU we have main flow and secondary flow, the state is influenced only by the main flow, but Dialogues & Discourses will initiate a secondary flow (Diatribe) if the case;
# Queries states (as past states) will be treated differently in pipelines because of their specificities.

# adapt code for imprementing the table:<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.06215846994535519, 'fraction_numerical': 0.00819672131147541, 'mean_word_length': 4.979591836734694, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '1', 'dir': 'jupyter-structured-clean-dedup', 'id': '292796', 'license': 'Apache-2.0', 'n_tokens_mistral': 388, 'n_tokens_neox': 371, 'n_words': 225, 'path': 'CPL Conversational Policy Learning/26_States_dummy_code.ipynb', 'repo_name': 'Cezanne-ai/project-2021', 'size': '1464'}