<jupyter_start><jupyter_text>**pytorch prednet practice****train and test preprocessed kitti data****using google colaboratory** clone source files<jupyter_code>!git clone https://github.com/shun60s/pytorch-prednet-practice<jupyter_output><empty_output><jupyter_text>change working directory<jupyter_code>%cd pytorch-prednet-practice<jupyter_output><empty_output><jupyter_text>check file tree<jupyter_code>!ls -l<jupyter_output>total 104
-rw-r--r-- 1 root root  5179 Mar 25 03:36 convlstmcell.py
drwxr-xr-x 2 root root  4096 Mar 25 03:36 docs
-rw-r--r-- 1 root root 22215 Mar 25 03:36 hickle.py
drwxr-xr-x 2 root root  4096 Mar 25 03:36 kitti_data
-rw-r--r-- 1 root root  2779 Mar 25 03:36 kitti_data.py
-rw-r--r-- 1 root root  4325 Mar 25 03:36 kitti_test.py
-rw-r--r-- 1 root root 10587 Mar 25 03:36 kitti_train.py
-rw-r--r-- 1 root root  1109 Mar 25 03:36 LICENSE_hickle
-rw-r--r-- 1 root root  1063 Mar 25 03:36 License_prednet.txt
-rw-r--r-- 1 root root  1117 Mar 25 03:36 LICENSE_torchMoji
drwxr-xr-x 2 root root  4096 Mar 25 03:36 logs
-rw-r--r-- 1 root root  7247 Mar 25 03:36 prednet.py
-rw-r--r-- 1 root root   736 Mar 25 03:36 README_leido_pytorch-prednet.md
-rw-r--r-- 1 root root  2329 Mar 25 03:36 README.md
drwxr-xr-x 2 root root  4096 Mar 25 03:36 results
drwxr-xr-x 2 root root  4096 Mar 25 03:36 trained<jupyter_text>get preprocessed KITTI data (2G) and unzip it<jupyter_code>!wget -P "/kitti_data" www.dropbox.com/s/rpwlnn6j39jjme4/kitti_data.zip?dl=0
!unzip "/kitti_data/kitti_data.zip?dl=0" -d ./kitti_data/<jupyter_output><empty_output><jupyter_text>train with GPU,  set gpu-id= 0specify number of epoch(--epoch)it will take aroud 5 minutes per one epoch<jupyter_code>!python kitti_train.py --gpu-id 0 --epoch 2<jupyter_output><empty_output><jupyter_text>test predictedspecify output file number(--num-output)<jupyter_code>!python kitti_test.py --gpu-id 0  --num-output 10<jupyter_output><empty_output><jupyter_text>test extrapolatedspecify extrap_start_time(-et) < num of time steps(-nt)<jupyter_code>!python kitti_test.py --gpu-id 0 --nt 10 --et 7 --num-output 10<jupyter_output><empty_output>
{'fraction_non_alphanumeric': 0.1213982050070855, 'fraction_numerical': 0.09541804440245631, 'mean_word_length': 4.487046632124352, 'pattern_counts': {'":': 0, '<': 29, '<?xml version=': 0, '>': 28, 'https://': 1, 'lorem ipsum': 0, 'www.': 1, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '7', 'dir': 'jupyter-structured-clean-dedup', 'id': '93126', 'license': 'MIT', 'n_tokens_mistral': 1024, 'n_tokens_neox': 860, 'n_words': 225, 'path': 'prednet_kitti_data_colab_practice1.ipynb', 'repo_name': 'shun60s/pytorch-prednet-experiment-', 'size': '2117'}