<jupyter_start><jupyter_text>Unicode in Python Python 3 **Types of String**- Bytes- Unicode<jupyter_code>type('This is string')
type(b'This is byte string')
p = b'i'
p.decode('ascii')
p.decode('iso-8859-1')
p.decode('utf-8')
p.decode('utf-16-be')
[1] [1][1] [1][1][1]
import codecs
t1 = 'é'
m = t1.encode()
m
m.decode()
ord('a')
hex(97)
2 ** 16
ord('क')<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.2245430809399478, 'fraction_numerical': 0.057441253263707574, 'mean_word_length': 5.9818181818181815, 'pattern_counts': {'":': 0, '<': 5, '<?xml version=': 0, '>': 5, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '1', 'dir': 'jupyter-structured-clean-dedup', 'id': '397096', 'license': 'CC-BY-4.0', 'n_tokens_mistral': 183, 'n_tokens_neox': 173, 'n_words': 38, 'path': 'References/PythonAdvance/Unicode3.ipynb', 'repo_name': 'JahBirShakya/pysessions', 'size': '383'}