<commit_before>.span8

  %h1 Data

  %p
    Since January 2012, we've tracked and archived plow activity for <strong>#{Past_storms.length} snow events</strong> in Chicago. 
    %br
    You can download the raw data from past storms here.

  %h3#usage Using this data
  %p
    We save every GPS observation we scrape from the <a href='http://www.cityofchicago.org/city/en/depts/mayor/iframe/plow_tracker.html'>City of Chicago Plow Tracker</a>. Each observation contains:

  %ul
    %li
      location X and Y (projected in <a href='http://spatialreference.org/ref/esri/102671/'>EPSG 102671</a> or latitude/longitude)
    %li
      date and time of observation
    %li
      vehicle ID (for example S11375)

  %p
    We make these points available in a <a href='http://www.sqlite.org/'>SQLite3 database</a>. The easiest way to work with this data is to run the points through our <a href='https://github.com/datamade/clearstreets-processing/blob/master/slurp2gpx/write_gpx_all.py'>write_gpx_all.py</a> script to generate a set of <a href='http://en.wikipedia.org/wiki/GPS_Exchange_Format'>GPX files</a> (one for each plow). From there, you can import it into <a href='http://www2.qgis.org/en/site/'>QGIS</a> or write a script to analyze it.

  %p
    %strong Please note: 
    Sometimes our data feed breaks while collecting plow locations from the City of Chicago Plow Tracker. This means that some of our data has gaps in it for periods of time.

  %h3 Past storms

  %table.table.table-striped.table-bordered
    %thead
      %tr
        %th{:style => "width: 20%;"} 
          Date
        %th Snowfall
        %th GPS observations
        %th Map
        %th Notes
    %tbody
      - Past_storms.each do |f|
        %tr
          %td #{f[:title]}
          %td #{f[:snowfall]}
          %td 
            - if f[:show_gpx]
              %a{:href => "https://s3.amazonaws.com/clearstreets-data/#{f[:backup_folder]}/gpx-#{f[:backup_folder]}.tar.gz"} <i class='icon-download-alt'></i> GPX traces
              %br
            - unless f[:backup_folder].empty?
              %a{:href => "https://s3.amazonaws.com/clearstreets-data/#{f[:backup_folder]}/plow-#{f[:backup_folder]}.db"} <i class='icon-download-alt'></i> SQLite
          %td 
            - unless f[:fusion_table_id].nil?
              %a{:href => "https://www.google.com/fusiontables/DataSource?docid=#{f[:fusion_table_id]}"} Fusion&nbsp;Table
            - unless f[:carto_db_url].nil?
              %a{:href => f[:carto_db_url]} CartoDB<commit_msg>hiding map column from data table<commit_after>.span8

  %h1 Data

  %p
    Since January 2012, we've tracked and archived plow activity for <strong>#{Past_storms.length} snow events</strong> in Chicago. 
    %br
    You can download the raw data from past storms here.

  %h3#usage Using this data
  %p
    We save every GPS observation we scrape from the <a href='http://www.cityofchicago.org/city/en/depts/mayor/iframe/plow_tracker.html'>City of Chicago Plow Tracker</a>. Each observation contains:

  %ul
    %li
      location X and Y (projected in <a href='http://spatialreference.org/ref/esri/102671/'>EPSG 102671</a> or latitude/longitude)
    %li
      date and time of observation
    %li
      vehicle ID (for example S11375)

  %p
    We make these points available in a <a href='http://www.sqlite.org/'>SQLite3 database</a>. The easiest way to work with this data is to run the points through our <a href='https://github.com/datamade/clearstreets-processing/blob/master/slurp2gpx/write_gpx_all.py'>write_gpx_all.py</a> script to generate a set of <a href='http://en.wikipedia.org/wiki/GPS_Exchange_Format'>GPX files</a> (one for each plow). From there, you can import it into <a href='http://www2.qgis.org/en/site/'>QGIS</a> or write a script to analyze it.

  %p
    %strong Please note: 
    Sometimes our data feed breaks while collecting plow locations from the City of Chicago Plow Tracker. This means that some of our data has gaps in it for periods of time.

  %h3 Past storms

  %table.table.table-striped.table-bordered
    %thead
      %tr
        %th{:style => "width: 20%;"} 
          Date
        %th Snowfall
        %th GPS observations
        %th Notes
    %tbody
      - Past_storms.each do |f|
        %tr
          %td #{f[:title]}
          %td #{f[:snowfall]}
          %td 
            - if f[:show_gpx]
              %a{:href => "https://s3.amazonaws.com/clearstreets-data/#{f[:backup_folder]}/gpx-#{f[:backup_folder]}.tar.gz"} <i class='icon-download-alt'></i> GPX traces
              %br
            - unless f[:backup_folder].empty?
              %a{:href => "https://s3.amazonaws.com/clearstreets-data/#{f[:backup_folder]}/plow-#{f[:backup_folder]}.db"} <i class='icon-download-alt'></i> SQLite
{'fraction_non_alphanumeric': 0.13055380080016846, 'fraction_numerical': 0.013476521372920615, 'mean_word_length': 2.787878787878788, 'pattern_counts': {'":': 0, '<': 39, '<?xml version=': 0, '>': 47, 'https://': 7, 'lorem ipsum': 0, 'www.': 7, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 6, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5583001', 'n_tokens_mistral': 1625, 'n_tokens_neox': 1548, 'n_words': 443}