The \(<\)\(|\)startofthought\(|>\) and \(<\)\(|\)endofthought\(|>\) tokens serve as learned meta-tokens that control the model's rationale generation. Optimizing the representation of these tokens, especially the \(<\)\(|\)startofthought\(|>\) token, is crucial but challenging due to the discrete nature of the rationale tokens. We initialize the start and end token embeddings to the embedding corresponding to the em dash, "---", which often appears in text data to denote a pause or thought. This leverages the language model's preexisting knowledge. In addition, to allow these embeddings to be optimized more quickly, we apply a (hyperparameter) weight to the gradients of these embeddings during the update step. Intuitively, the start thought tokens can be understood as putting the model into a "thinking mode" and the end thought token can be understood as telling the model when it's done thinking.