<jupyter_start><jupyter_text>COVID Case Data<jupyter_code>!wget https://opendata.arcgis.com/datasets/bbb2e4f589ba40d692fab712ae37b9ac_2.csv -O data/countrycases.csv<jupyter_output>--2020-07-12 02:43:22--  https://opendata.arcgis.com/datasets/bbb2e4f589ba40d692fab712ae37b9ac_2.csv
Resolving opendata.arcgis.com (opendata.arcgis.com)... 172.16.58.3, 172.16.17.32, 172.16.17.32
Connecting to opendata.arcgis.com (opendata.arcgis.com)|172.16.58.3|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: unspecified [text/csv]
Saving to: ‘data/countrycases.csv’

data/countrycases.c     [ <=>                ]  16.09K  --.-KB/s    in 0s      

2020-07-12 02:43:23 (60.3 MB/s) - ‘data/countrycases.csv’ saved [16475]<jupyter_text>COVID Cases Time Series  Narrow CSV<jupyter_code>!wget 'https://data.humdata.org/hxlproxy/data/download/time_series_covid19_confirmed_global_narrow.csv?dest=data_edit&filter01=explode&explode-header-att01=date&explode-value-att01=value&filter02=rename&rename-oldtag02=%23affected%2Bdate&rename-newtag02=%23date&rename-header02=Date&filter03=rename&rename-oldtag03=%23affected%2Bvalue&rename-newtag03=%23affected%2Binfected%2Bvalue%2Bnum&rename-header03=Value&filter04=clean&clean-date-tags04=%23date&filter05=sort&sort-tags05=%23date&sort-reverse05=on&filter06=sort&sort-tags06=%23country%2Bname%2C%23adm1%2Bname&tagger-match-all=on&tagger-default-tag=%23affected%2Blabel&tagger-01-header=province%2Fstate&tagger-01-tag=%23adm1%2Bname&tagger-02-header=country%2Fregion&tagger-02-tag=%23country%2Bname&tagger-03-header=lat&tagger-03-tag=%23geo%2Blat&tagger-04-header=long&tagger-04-tag=%23geo%2Blon&header-row=1&url=https%3A%2F%2Fraw.githubusercontent.com%2FCSSEGISandData%2FCOVID-19%2Fmaster%2Fcsse_covid_19_data%2Fcsse_covid_19_time_series%2Ftime_series_covid19_confirmed_global.csv' -O data/time_series_covid19_deaths_global_narrow.csv<jupyter_output>--2020-07-12 02:43:24--  https://data.humdata.org/hxlproxy/data/download/time_series_covid19_confirmed_global_narrow.csv?dest=data_edit&filter01=explode&explode-header-att01=date&explode-value-att01=value&filter02=rename&rename-oldtag02=%23affected%2Bdate&rename-newtag02=%23date&rename-header02=Date&filter03=rename&rename-oldtag03=%23affected%2Bvalue&rename-newtag03=%23affected%2Binfected%2Bvalue%2Bnum&rename-header03=Value&filter04=clean&clean-date-tags04=%23date&filter05=sort&sort-tags05=%23date&sort-reverse05=on&filter06=sort&sort-tags06=%23country%2Bname%2C%23adm1%2Bname&tagger-match-all=on&tagger-default-tag=%23affected%2Blabel&tagger-01-header=province%2Fstate&tagger-01-tag=%23adm1%2Bname&tagger-02-header=country%2Fregion&tagger-02-tag=%23country%2Bname&tagger-03-header=lat&tagger-03-tag=%23geo%2Blat&tagger-04-header=long&tagger-04-tag=%23geo%2Blon&header-row=1&url=https%3A%2F%2Fraw.githubusercontent.com%2FCSSEGISandData%2FCOVID-19%2Fmaster%2Fcsse_covid_19_data%2Fcsse_covid_19_ti[...]<jupyter_text>Covid Deaths Time Series<jupyter_code>!wget 'https://data.humdata.org/hxlproxy/data/download/time_series_covid19_deaths_global_narrow.csv?dest=data_edit&filter01=explode&explode-header-att01=date&explode-value-att01=value&filter02=rename&rename-oldtag02=%23affected%2Bdate&rename-newtag02=%23date&rename-header02=Date&filter03=rename&rename-oldtag03=%23affected%2Bvalue&rename-newtag03=%23affected%2Binfected%2Bvalue%2Bnum&rename-header03=Value&filter04=clean&clean-date-tags04=%23date&filter05=sort&sort-tags05=%23date&sort-reverse05=on&filter06=sort&sort-tags06=%23country%2Bname%2C%23adm1%2Bname&tagger-match-all=on&tagger-default-tag=%23affected%2Blabel&tagger-01-header=province%2Fstate&tagger-01-tag=%23adm1%2Bname&tagger-02-header=country%2Fregion&tagger-02-tag=%23country%2Bname&tagger-03-header=lat&tagger-03-tag=%23geo%2Blat&tagger-04-header=long&tagger-04-tag=%23geo%2Blon&header-row=1&url=https%3A%2F%2Fraw.githubusercontent.com%2FCSSEGISandData%2FCOVID-19%2Fmaster%2Fcsse_covid_19_data%2Fcsse_covid_19_time_series%2Ftime_series_covid19_deaths_global.csv' -O data/Deaths.csv<jupyter_output>--2020-07-12 02:43:35--  https://data.humdata.org/hxlproxy/data/download/time_series_covid19_deaths_global_narrow.csv?dest=data_edit&filter01=explode&explode-header-att01=date&explode-value-att01=value&filter02=rename&rename-oldtag02=%23affected%2Bdate&rename-newtag02=%23date&rename-header02=Date&filter03=rename&rename-oldtag03=%23affected%2Bvalue&rename-newtag03=%23affected%2Binfected%2Bvalue%2Bnum&rename-header03=Value&filter04=clean&clean-date-tags04=%23date&filter05=sort&sort-tags05=%23date&sort-reverse05=on&filter06=sort&sort-tags06=%23country%2Bname%2C%23adm1%2Bname&tagger-match-all=on&tagger-default-tag=%23affected%2Blabel&tagger-01-header=province%2Fstate&tagger-01-tag=%23adm1%2Bname&tagger-02-header=country%2Fregion&tagger-02-tag=%23country%2Bname&tagger-03-header=lat&tagger-03-tag=%23geo%2Blat&tagger-04-header=long&tagger-04-tag=%23geo%2Blon&header-row=1&url=https%3A%2F%2Fraw.githubusercontent.com%2FCSSEGISandData%2FCOVID-19%2Fmaster%2Fcsse_covid_19_data%2Fcsse_covid_19_time_[...]<jupyter_text>Armed Conflict Locations<jupyter_code>!wget https://acleddata.com/download/2909/ -O data/africa-conflict.xlsx<jupyter_output>--2020-07-09 14:27:11--  https://acleddata.com/download/2909/
Resolving acleddata.com (acleddata.com)... failed: Temporary failure in name resolution.
wget: unable to resolve host address ‘acleddata.com’<jupyter_text>Google Mobility Data<jupyter_code>!wget https://www.gstatic.com/covid19/mobility/Global_Mobility_Report.csv?cachebust=9cfdda8c20841ad1 -O data/Global_Mobility_Report.csv<jupyter_output>--2020-07-09 14:27:27--  https://www.gstatic.com/covid19/mobility/Global_Mobility_Report.csv?cachebust=9cfdda8c20841ad1
Resolving www.gstatic.com (www.gstatic.com)... 172.16.17.32, fc00:db20:35b:7399::5
Connecting to www.gstatic.com (www.gstatic.com)|172.16.17.32|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 44186309 (42M) [text/csv]
Saving to: ‘data/Global_Mobility_Report.csv’

data/Global_Mobilit 100%[===================>]  42.14M  89.3MB/s    in 0.5s    

2020-07-09 14:27:28 (89.3 MB/s) - ‘data/Global_Mobility_Report.csv’ saved [44186309/44186309]<jupyter_text>Building Footprints<jupyter_code>!mkdir -p data/geofabrik/<jupyter_output><empty_output><jupyter_text>Uganda<jupyter_code>!wget https://download.geofabrik.de/africa/uganda-latest-free.shp.zip -O data/geofabrik/uganda-latest-free.shp.zip
!mkdir -p data/geofabrik/uganda-latest-free
!unzip data/geofabrik/uganda-latest-free.shp.zip -d data/geofabrik/uganda-latest-free
!rm data/geofabrik/uganda-latest-free.shp.zip
!rm data/geofabrik/uganda-latest-free/gis*landuse*.*
!rm data/geofabrik/uganda-latest-free/gis*natural*.*
!rm data/geofabrik/uganda-latest-free/gis*places*.*
!rm data/geofabrik/uganda-latest-free/gis*pofw*.*
!rm data/geofabrik/uganda-latest-free/gis*pois*.*
!rm data/geofabrik/uganda-latest-free/gis*railways*.*
!rm data/geofabrik/uganda-latest-free/gis*roads*.*
!rm data/geofabrik/uganda-latest-free/gis*traffic*.*
!rm data/geofabrik/uganda-latest-free/gis*transport*.*
!rm data/geofabrik/uganda-latest-free/gis*water*.*
!ls -la data/geofabrik/uganda-latest-free/<jupyter_output>total 1643060
drwxr-xr-x 2 jovyan users      4096 Jul  9 14:28 .
drwxr-xr-x 3 jovyan users      4096 Jul  9 14:28 ..
-rw-rw-r-- 1 jovyan users         6 Jul  8 20:32 gis_osm_buildings_a_free_1.cpg
-rw-rw-r-- 1 jovyan users 816052848 Jul  8 20:33 gis_osm_buildings_a_free_1.dbf
-rw-rw-r-- 1 jovyan users       144 Jul  8 20:32 gis_osm_buildings_a_free_1.prj
-rw-rw-r-- 1 jovyan users 826354040 Jul  8 20:33 gis_osm_buildings_a_free_1.shp
-rw-rw-r-- 1 jovyan users  40051764 Jul  8 20:33 gis_osm_buildings_a_free_1.shx
-rw-rw-r-- 1 jovyan users       651 Jul  8 20:33 README<jupyter_text>Kenya<jupyter_code>!wget https://download.geofabrik.de/africa/kenya-latest-free.shp.zip -O data/geofabrik/kenya-latest-free.shp.zip
!mkdir -p data/geofabrik/kenya-latest-free
!unzip data/geofabrik/kenya-latest-free.shp.zip -d data/geofabrik/kenya-latest-free
!rm data/geofabrik/kenya-latest-free.shp.zip
!rm data/geofabrik/kenya-latest-free/gis*landuse*.*
!rm data/geofabrik/kenya-latest-free/gis*natural*.*
!rm data/geofabrik/kenya-latest-free/gis*places*.*
!rm data/geofabrik/kenya-latest-free/gis*pofw*.*
!rm data/geofabrik/kenya-latest-free/gis*pois*.*
!rm data/geofabrik/kenya-latest-free/gis*railways*.*
!rm data/geofabrik/kenya-latest-free/gis*roads*.*
!rm data/geofabrik/kenya-latest-free/gis*traffic*.*
!rm data/geofabrik/kenya-latest-free/gis*transport*.*
!rm data/geofabrik/kenya-latest-free/gis*water*.*
!ls -la data/geofabrik/kenya-latest-free/<jupyter_output>total 662084
drwxr-xr-x 2 jovyan users      4096 Jul  9 14:29 .
drwxr-xr-x 4 jovyan users      4096 Jul  9 14:29 ..
-rw-rw-r-- 1 jovyan users         6 Jul  8 20:31 gis_osm_buildings_a_free_1.cpg
-rw-rw-r-- 1 jovyan users 332681890 Jul  8 20:31 gis_osm_buildings_a_free_1.dbf
-rw-rw-r-- 1 jovyan users       144 Jul  8 20:31 gis_osm_buildings_a_free_1.prj
-rw-rw-r-- 1 jovyan users 328935860 Jul  8 20:31 gis_osm_buildings_a_free_1.shp
-rw-rw-r-- 1 jovyan users  16328036 Jul  8 20:31 gis_osm_buildings_a_free_1.shx
-rw-rw-r-- 1 jovyan users       650 Jul  8 20:31 README<jupyter_text>Tanzania<jupyter_code>!wget https://download.geofabrik.de/africa/tanzania-latest-free.shp.zip -O data/geofabrik/tanzania-latest-free.shp.zip
!mkdir -p data/geofabrik/tanzania-latest-free
!unzip data/geofabrik/tanzania-latest-free.shp.zip -d data/geofabrik/tanzania-latest-free
!rm data/geofabrik/tanzania-latest-free.shp.zip
!rm data/geofabrik/tanzania-latest-free/gis*landuse*.*
!rm data/geofabrik/tanzania-latest-free/gis*natural*.*
!rm data/geofabrik/tanzania-latest-free/gis*places*.*
!rm data/geofabrik/tanzania-latest-free/gis*pofw*.*
!rm data/geofabrik/tanzania-latest-free/gis*pois*.*
!rm data/geofabrik/tanzania-latest-free/gis*railways*.*
!rm data/geofabrik/tanzania-latest-free/gis*roads*.*
!rm data/geofabrik/tanzania-latest-free/gis*traffic*.*
!rm data/geofabrik/tanzania-latest-free/gis*transport*.*
!rm data/geofabrik/tanzania-latest-free/gis*water*.*
!ls -la data/geofabrik/tanzania-latest-free/<jupyter_output>total 3594512
drwxr-xr-x 2 jovyan users       4096 Jul  9 14:31 .
drwxr-xr-x 5 jovyan users       4096 Jul  9 14:30 ..
-rw-rw-r-- 1 jovyan users          6 Jul  8 20:38 gis_osm_buildings_a_free_1.cpg
-rw-rw-r-- 1 jovyan users 1855203765 Jul  8 20:40 gis_osm_buildings_a_free_1.dbf
-rw-rw-r-- 1 jovyan users        144 Jul  8 20:38 gis_osm_buildings_a_free_1.prj
-rw-rw-r-- 1 jovyan users 1734490708 Jul  8 20:40 gis_osm_buildings_a_free_1.shp
-rw-rw-r-- 1 jovyan users   91053036 Jul  8 20:40 gis_osm_buildings_a_free_1.shx
-rw-rw-r-- 1 jovyan users        653 Jul  8 20:40 README<jupyter_text>GDP Data<jupyter_code>!wget http://api.worldbank.org/v2/en/indicator/NY.GDP.PCAP.CD?downloadformat=csv -O data/GDP.csv.zip
!unzip data/GDP.csv.zip -d data
!rm data/GDP.csv.zip<jupyter_output>Archive:  data/GDP.csv.zip
  End-of-central-directory signature not found.  Either this file is not
  a zipfile, or it constitutes one disk of a multi-part archive.  In the
  latter case the central directory and zipfile comment will be found on
  the last disk(s) of this archive.
unzip:  cannot find zipfile directory in one of data/GDP.csv.zip or
        data/GDP.csv.zip.zip, and cannot find data/GDP.csv.zip.ZIP, period.<jupyter_text>Employment Data<jupyter_code>! wget http://api.worldbank.org/v2/en/indicator/SL.EMP.TOTL.SP.MA.ZS?downloadformat=csv -O data/Emp.csv.zip
!unzip data/Emp.csv.zip -d data
!rm data/Emp.csv.zip<jupyter_output>Archive:  data/Emp.csv.zip
  inflating: data/Metadata_Indicator_API_SL.EMP.TOTL.SP.MA.ZS_DS2_en_csv_v2_1222654.csv  
  inflating: data/API_SL.EMP.TOTL.SP.MA.ZS_DS2_en_csv_v2_1222654.csv  
  inflating: data/Metadata_Country_API_SL.EMP.TOTL.SP.MA.ZS_DS2_en_csv_v2_1222654.csv<jupyter_text>Human Development Index Data<jupyter_code>!wget http://api.worldbank.org/v2/en/indicator/UNDP.HDI.XD?downloadformat=csv  -O data/Human_Dev_Index.csv.zip
!unzip data/Human_Dev_Index.csv.zip -d data
!rm data/Human_Dev_Index.csv.zip<jupyter_output>Archive:  data/Human_Dev_Index.csv.zip
  inflating: data/Metadata_Indicator_API_UNDP.HDI.XD_DS11_en_csv_v2_1263520.csv  
  inflating: data/API_UNDP.HDI.XD_DS11_en_csv_v2_1263520.csv  
  inflating: data/Metadata_Country_API_UNDP.HDI.XD_DS11_en_csv_v2_1263520.csv<jupyter_text>Population Data<jupyter_code>!wget https://datacenter.prb.org/download/international/indicator/population/csv?geos=AFRICA -O data/Popdata.csv<jupyter_output>--2020-07-12 04:38:39--  https://datacenter.prb.org/download/international/indicator/population/csv?geos=AFRICA
Resolving datacenter.prb.org (datacenter.prb.org)... 172.16.17.32
Connecting to datacenter.prb.org (datacenter.prb.org)|172.16.17.32|:443... connected.
HTTP request sent, awaiting response... 200 OK
Length: 2287 (2.2K) [text/csv]
Saving to: ‘data/Popdata.csv’

data/Popdata.csv    100%[===================>]   2.23K  --.-KB/s    in 0s      

2020-07-12 04:38:39 (175 MB/s) - ‘data/Popdata.csv’ saved [2287/2287]
{'fraction_non_alphanumeric': 0.14361091993576508, 'fraction_numerical': 0.09061711401697638, 'mean_word_length': 5.875920084121977, 'pattern_counts': {'":': 0, '<': 42, '<?xml version=': 0, '>': 44, 'https://': 15, 'lorem ipsum': 0, 'www.': 6, 'xml': 0}, 'pii_count': 8, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 15, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'chain_length': '13', 'dir': 'jupyter-structured-clean-dedup', 'id': '213426', 'license': 'Apache-2.0', 'n_tokens_mistral': 6345, 'n_tokens_neox': 5632, 'n_words': 598, 'path': 'NB02-Data-Sources.ipynb', 'repo_name': 'PHI-Case-Studies/2019-COVID19-Africa-Basic', 'size': '13090'}