<commit_before>RecordEncoder
============

RecordEncoder can be chained to an activerecord relation or a class and will yield encoded representation


Installation
-----------

    gem install record_encoder

or by including this line in your Gemfile

    gem "record_encoder", :git => "git://github.com/tskorupa/record_encoder.git"

Usage
-----

    require 'record_encoder'

    Class Foo < ActiveRecord::Base
      acts_as_record_encoder
    end

    irb(main):004:0> Foo.to_bert {|r| puts r.inspect }
    "\x83l\x00\x00\x00\x01h\x02d\x00\tfoos"
       (0.7ms)  SELECT COUNT(*) FROM "foos"
    "l\u0000\u0000\u0000\u0000"
      Foo Load (0.5ms)  SELECT  "foos".* FROM "foos"   ORDER BY "foos"."id" ASC LIMIT 1000
    "j"
    "j"
    => nil
    irb(main):005:0>

TODO
================

<commit_msg>[ADD] additional fixme<commit_after>RecordEncoder
============

RecordEncoder can be chained to an activerecord relation or a class and will yield encoded representation


Installation
-----------

    gem install record_encoder

or by including this line in your Gemfile

    gem "record_encoder", :git => "git://github.com/tskorupa/record_encoder.git"

Usage
-----

    require 'record_encoder'

    Class Foo < ActiveRecord::Base
      acts_as_record_encoder
    end

    irb(main):004:0> Foo.to_bert {|r| puts r.inspect }
    "\x83l\x00\x00\x00\x01h\x02d\x00\tfoos"
       (0.7ms)  SELECT COUNT(*) FROM "foos"
    "l\u0000\u0000\u0000\u0000"
      Foo Load (0.5ms)  SELECT  "foos".* FROM "foos"   ORDER BY "foos"."id" ASC LIMIT 1000
    "j"
    "j"
    => nil
    irb(main):005:0>

TODO
================

FIXME
================
- RuntimeError: Cannot encode to erlang external format: #<BigDecimal:7fa7959aa760,'0.1E3',9(27)>

{'fraction_non_alphanumeric': 0.1653179190751445, 'fraction_numerical': 0.06127167630057803, 'mean_word_length': 3.1018957345971563, 'pattern_counts': {'":': 0, '<': 6, '<?xml version=': 0, '>': 12, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '443848', 'n_tokens_mistral': 700, 'n_tokens_neox': 608, 'n_words': 154}