<commit_before>---
layout: post
title: "redis vs rabbitmq"
category: devtool
tags: [taskqueue]
comments: true
---
{% include JB/setup %}

Looking to track things that aren't found in main blogs to influence decision (which to use with celery.)
  
So far, there is a claim that redis sometimes will hang and then tasks will queue up until memory exhaustion and this isn't a problem with RabbitMQ.
  
Someone claims experiencing BSODs with RabbitMQ - luckily I'm not counting on windows mwuhahaha!

<commit_msg>blog content<commit_after>---
layout: post
title: "redis vs rabbitmq"
category: devtool
tags: [taskqueue]
comments: true
---
{% include JB/setup %}

Looking to track things that aren't found in main blogs to influence decision (which to use with celery.)
  
So far, there is a claim that redis sometimes will hang and then tasks will queue up until memory exhaustion and this isn't a problem with RabbitMQ.
  
Someone claims experiencing BSODs with RabbitMQ - luckily I'm not counting on windows mwuhahaha!

  
  
some background tips until i reorganize this:
  
<https://library.launchkit.io/three-quick-tips-from-two-years-with-celery-c05ff9d7f9eb#.96pcx3hhv>


{'fraction_non_alphanumeric': 0.07252559726962457, 'fraction_numerical': 0.006825938566552901, 'mean_word_length': 4.236607142857143, 'pattern_counts': {'":': 0, '<': 4, '<?xml version=': 0, '>': 4, 'https://': 1, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '5815893', 'n_tokens_mistral': 371, 'n_tokens_neox': 335, 'n_words': 155}