<commit_before># Sports example

Example application that illustrates PartitionedFileSet datasets using sport results.

Features introduced: Partitioned file sets, MapReduce with runtime arguments, Ad-hoc queries over file sets.

- Uses a partitioned file set to store game results. It is partitioned by league and season, and each partition
  is a file containing the results in one league for a season; for example, the 2014 season of the NFL
  (National Football League).
- Results are uploaded into the file set using a service.
- The results can be explored using ad-hoc SQL queries.
- A MapReduce program reads all results for a league and aggregates total counts across all seasons, and writes
  these to another partitioned table that is partitioned only by league.
- The totals can also be queried using ad-hoc SQL.

For more information on running CDAP examples, see
http://docs.cask.co/cdap/current/en/examples-manual/examples/index.html.

Cask is a trademark of Cask Data, Inc. All rights reserved.

Copyright © 2015 Cask Data, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file
except in compliance with the License. You may obtain a copy of the License at

  http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the
License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
either express or implied. See the License for the specific language governing permissions
and limitations under the License.<commit_msg>clarify \"conceded\"<commit_after># Sports example

Example application that illustrates PartitionedFileSet datasets using sport results.

Features introduced: Partitioned file sets, MapReduce with runtime arguments, Ad-hoc queries over file sets.

- Uses a partitioned file set to store game results. It is partitioned by league and season, and each partition
  is a file containing the results in one league for a season; for example, the 2014 season of the NFL
  (National Football League).
- Results are uploaded into the file set using a service.
- The results can be explored using ad-hoc SQL queries.
- A MapReduce program that reads game results for a sports league and
  aggregates total counts such as games won and lost, points scored and conceded, across all
  seasons, and writes the results to a partitioned file set that is partitioned by league.
- The totals can also be queried using ad-hoc SQL.

For more information on running CDAP examples, see
http://docs.cask.co/cdap/current/en/examples-manual/examples/index.html.

Cask is a trademark of Cask Data, Inc. All rights reserved.

Copyright © 2015 Cask Data, Inc.

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this file
except in compliance with the License. You may obtain a copy of the License at

  http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the
License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND,
either express or implied. See the License for the specific language governing permissions
and limitations under the License.
{'fraction_non_alphanumeric': 0.047619047619047616, 'fraction_numerical': 0.0074211502782931356, 'mean_word_length': 4.329489291598023, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1769043', 'n_tokens_mistral': 827, 'n_tokens_neox': 781, 'n_words': 471}