<commit_before># Backend for node.js

## Installation

  Default settings are to be run on Linux instance with /data as the root for
  backend config and all other files
  
## Development environment (Mac OS X)  

 - git clone https://vseryakov@bitbucket.org/vseryakov/backend.git
 - cd backend
 - to install node.js and required modules if it is not installed run
   command:
   
      bin/rc.backend build-dev

 - to initialize environment for the backend development run
   command:
   
     bin/rc.backend init-backend
   
 - to compile the binary module just type ```make```
 - to run local server on port 8000 run
   command:   
   
     make run
 
 - to start the backend in command line mode, the backend environment is prepared and initialized including all database pools.   
   This command line access allows to test and run all functions from all modules of the backend without running full server 
   similar to node.js REPL functionality. All modules are accessible from the command line.
   
     # make repl
   
     > core.version  
     '2013.10.20.0'  
     > logger.setDebug(2)  
     
## Configuration

 The backend directory structure is the following:
 
 - data/ - root directory for the backend
   - etc 
     - config - config parameters, same as specified in the command line but without leading -, each config parameter per line:
     
       Example:
       
        debug=1  
        api-pool=ddb  
        db-ddb-pool=http://localhost:9000  
        db-pg-pool=postgresql://postgres@127.0.0.1/backend
         
     - crontab - jobs to be run with intervals, local or remote, JSON file with a list of cron jobs objects:
     
       Example:  
       
        [ { "type": "local", "cron": "0 0 0,8 * * *", "job": "reports.create" },  
          { "type": "remote", "cron": "0 1 1 * * 1,3", "args": { "-log": "debug" }, "job": { "scraper.run": { "url": "http://www.site.com" } } } ]
             
   - images - all images to be served by the API server
     - account - account specific images
   - var - runtime files and db files
     - backend.db - common sqlite database, always created and opened by the backend
   - tmp - temporary files
   - web - public files to be served by the web servers  

# Author
  <NAME>
<commit_msg>README.md edited online with Bitbucket<commit_after># Backend for node.js

## Installation

  Default settings are to be run on Linux instance with /data as the root for
  backend config and all other files
  
## Development environment (Mac OS X)  

 - git clone https://vseryakov@bitbucket.org/vseryakov/backend.git
 - cd backend
 - to install node.js and required modules if it is not installed run  
    command:
   
        bin/rc.backend build-dev

 - to initialize environment for the backend development run  
    command:
   
        bin/rc.backend init-backend
   
 - to compile the binary module just type ```make```
 - to run local server on port 8000 run  
    command:
   
        make run
 
 - to start the backend in command line mode, the backend environment is prepared and initialized including all database pools.   
   This command line access allows to test and run all functions from all modules of the backend without running full server 
   similar to node.js REPL functionality. All modules are accessible from the command line.
   
    $ make repl
   
    > core.version  
    '2013.10.20.0'  
    > logger.setDebug(2)  
     
## Configuration

 The backend directory structure is the following:
 
 - data/ - root directory for the backend
   - etc 
      - config - config parameters, same as specified in the command line but without leading -, each config parameter per line:
        Example:
        
            debug=1  
            api-pool=ddb  
            db-ddb-pool=http://localhost:9000  
            db-pg-pool=postgresql://postgres@127.0.0.1/backend
         
     - crontab - jobs to be run with intervals, local or remote, JSON file with a list of cron jobs objects:
        Example:  
       
            [ { "type": "local", "cron": "0 0 0,8 * * *", "job": "reports.create" },  
              { "type": "remote", "cron": "0 1 1 * * 1,3", "args": { "-log": "debug" }, "job": { "scraper.run": { "url": "http://www.site.com" } } } ]
             
   - images - all images to be served by the API server
     - account - account specific images
   - var - runtime files and db files
     - backend.db - common sqlite database, always created and opened by the backend
   - tmp - temporary files
   - web - public files to be served by the web servers  

# Author
  <NAME>

{'fraction_non_alphanumeric': 0.08542713567839195, 'fraction_numerical': 0.014856893161459472, 'mean_word_length': 2.303030303030303, 'pattern_counts': {'":': 20, '<': 5, '<?xml version=': 0, '>': 9, 'https://': 2, 'lorem ipsum': 0, 'www.': 2, 'xml': 0}, 'pii_count': 6, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 2, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '1709737', 'n_tokens_mistral': 1315, 'n_tokens_neox': 1244, 'n_words': 534}