<commit_before># Rebuild Backbone & put it into production

## Build new backbone on UAT
### build neo4j backbone
 - stop all UAT clis as the backbone build needs 40g memory, growing with more sources
 - configure nub builder to use prod db & registry services for reading source data https://github.com/gbif/gbif-configuration/blob/master/cli/uat/config/clb-nub.yaml
 - run neo4j nub build via '''./clb-buildnub.sh'''
### import into postgres 
 - dump prod clb db and import into boma (for faster writes) as db nub_build
 - configure clb importer to use boma nub_build db https://github.com/gbif/gbif-configuration/blob/master/cli/uat/config/clb-importer.yaml
 - start start-clb-importer.sh 
 - issue message to import neo4j backbone into postgres: ./clb-admin.sh IMPORT --nub
 - once imported, dump boma nub_build and copy to uat_checklistbank
 - stop-clb.sh

### rebuild nub lookup index on apps2.gbif-uat.org
 - cd /usr/local/gbif/services/checklistbank-nub-ws/2.xx/1234567
 - ./stop.sh
 - rm -Rf /usr/local/gbif/services/checklistbank-nub-ws/nub_idx
 - ./start.sh

## Reprocess occurrences

### Prepare UAT
 - Copy registry and directory databases from prod to UAT
 - Deploy release version registry-ws and checklist-bank-ws to UAT
 - Change UAT processor-interpreted config to use new HBase table
 - Update occurrence and clb related clis
 - Delete rabbit MQ queues (on UAT)
 - Change UAT [processor-interpreted config](https://github.com/gbif/gbif-configuration/blob/master/cli/uat/config/processor-interpreted.yaml) to use new HBase table and 12(?) threads<commit_msg>Update BACKBONE-BUILD.md<commit_after># Rebuild Backbone & put it into production

## Build new backbone on UAT

### build neo4j backbone
 - stop all UAT clis as the backbone build needs 40g memory, growing with more sources
 - configure nub builder to use prod db & registry services for reading source data https://github.com/gbif/gbif-configuration/blob/master/cli/uat/config/clb-nub.yaml
 - run neo4j nub build via '''./clb-buildnub.sh'''

### import into postgres 
 - dump prod clb db and import into boma (for faster writes) as db nub_build
 - configure clb importer to use boma nub_build db https://github.com/gbif/gbif-configuration/blob/master/cli/uat/config/clb-importer.yaml
 - start start-clb-importer.sh 
 - issue message to import neo4j backbone into postgres: ./clb-admin.sh IMPORT --nub
 - once imported, dump boma nub_build and copy to uat_checklistbank
 - stop-clb.sh

### rebuild nub lookup index on apps2.gbif-uat.org
 - cd /usr/local/gbif/services/checklistbank-nub-ws/2.xx/1234567
 - ./stop.sh
 - rm -Rf /usr/local/gbif/services/checklistbank-nub-ws/nub_idx
 - ./start.sh

## Reprocess occurrences

### Prepare UAT
 - Copy registry and directory databases from prod to UAT
 - Deploy release version registry-ws and checklist-bank-ws to UAT
 - Change UAT processor-interpreted config to use new HBase table
 - Update occurrence and clb related clis
 - Delete rabbit MQ queues (on UAT)
 - Change UAT [processor-interpreted config](https://github.com/gbif/gbif-configuration/blob/master/cli/uat/config/processor-interpreted.yaml) to use new HBase table and 12(?) threads
{'fraction_non_alphanumeric': 0.09794628751974724, 'fraction_numerical': 0.010110584518167456, 'mean_word_length': 3.811550151975684, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 6, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '732741', 'n_tokens_mistral': 1051, 'n_tokens_neox': 1001, 'n_words': 332}