<commit_before>TODO
====

* upload:

  - add Q1 and Q3: keys 'q1' and 'q3'
  - "description"

* bm_python_startup: add again python metadata, to get back the Python version
  in benchmark suite metadata. Same for bm_hg_startup.
* Skip bm_django_template on Python 3 older than 3.4
* Remove compare command or reimplement it using perf compare_to
* Add a --log option to create a log file. Use the logging module
  and replace print() with logger.error().
* Write a test to ensure that benchmarks listed in groups exist
* Decide if sqlalchemy benchmarks should only benchmark SELECT ALL
  or INSERT+SELECT?
* Run pep8 on Travis
* html5lib: 1 warmup, 3 runs: run 2 is always 10% slower!?


numpy benchmarks?
=================

* https://morepypy.blogspot.fr/2016/11/vectorization-extended-powerpc-and-s390x.html
* https://bitbucket.org/plan_rich/numpy-benchmark
<commit_msg>TODO: Bugs on old CPython version<commit_after>TODO
====

* upload:

  - add Q1 and Q3: keys 'q1' and 'q3'
  - "description"

* bm_python_startup: add again python metadata, to get back the Python version
  in benchmark suite metadata. Same for bm_hg_startup.
* Remove compare command or reimplement it using perf compare_to
* Add a --log option to create a log file. Use the logging module
  and replace print() with logger.error().
* Write a test to ensure that benchmarks listed in groups exist
* Decide if sqlalchemy benchmarks should only benchmark SELECT ALL
  or INSERT+SELECT?
* Run pep8 on Travis
* html5lib: 1 warmup, 3 runs: run 2 is always 10% slower!?


Bugs on old CPython version
===========================

* Python 3.5.0beta2: SyntaxError in parse() of chameleon/astutil.py,
  on parsing "def func(target):". Failed commits:

  * CPython 8a8f453c5a6d

* Skip bm_django_template on Python 3 older than 3.4:
  Python 3.3.6 final: django_template: django/utils/module_loading.py:
  "from importlib.util import find_spec as importlib_find"
  ImportError: cannot import name find_spec
  CPython 75e3630c6071

* sympy uses deprecated inspect.getargspec(), function removed from 3.6a0 then
  reintroduced. TODO: fix sympy upstream?
  sympy: sympy/core/function.py
  "inspect.getargspec(cls.eval)"
  module 'inspect' has no attribute 'getargspec'
  CPython 0d30940dd256


numpy benchmarks?
=================

* https://morepypy.blogspot.fr/2016/11/vectorization-extended-powerpc-and-s390x.html
* https://bitbucket.org/plan_rich/numpy-benchmark

{'fraction_non_alphanumeric': 0.10593569661995053, 'fraction_numerical': 0.033800494641384994, 'mean_word_length': 4.417410714285714, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 4, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '386054', 'n_tokens_mistral': 853, 'n_tokens_neox': 768, 'n_words': 279}