<commit_before>---
published: true
layout: post
draft: false
visible: 0
title: Amortized Rational Speech Act Framework
---
## Amortized Rational Speech Act Framework

### Short Intro

Rational Speech Act (RSA) framework is a famous Bayesian natural language understanding framework that accurately models various linguistic phenomena such as scalar implicature (i.e., "Some people are good." means "Some but not all people are good."). It can also model the dynamics of a reference game.

Over the years, I never had the chance to actually look deep into the model itself. It's Bayesian form is complicated and intriguing.
<commit_msg>Update 2019-11-14-amortized-RSA.md<commit_after>---
published: false
layout: post
draft: false
visible: 0
title: Amortized Rational Speech Act Framework
---
## Amortized Rational Speech Act Framework

### Short Intro

Rational Speech Act (RSA) framework is a famous Bayesian natural language understanding framework that accurately models various linguistic phenomena such as scalar implicature (i.e., "Some people are good." means "Some but not all people are good."). It can also model the dynamics of a reference game.

Over the years, I never had the chance to actually look deep into the model itself. It's Bayesian form is complicated and intriguing.
{'fraction_non_alphanumeric': 0.0627420604182804, 'fraction_numerical': 0.0077459333849728895, 'mean_word_length': 4.666666666666667, 'pattern_counts': {'":': 0, '<': 3, '<?xml version=': 0, '>': 3, 'https://': 0, 'lorem ipsum': 0, 'www.': 0, 'xml': 0}, 'pii_count': 0, 'substrings_counts': 0, 'word_list_counts': {'cursed_substrings.json': 0, 'profanity_word_list.json': 0, 'sexual_word_list.json': 0, 'zh_pornsignals.json': 0}}
{'dir': 'git-commits-cleaned', 'id': '6795304', 'n_tokens_mistral': 342, 'n_tokens_neox': 302, 'n_words': 183}