Uncapitalized letters are lost

#3
by drmeir - opened

The output displays only <unk> instead of the uncapitalized letters. The letters themselves are totally lost. They do not appear in lower case.

Similar to #4, upper-cased tokens will be OOV.

Sign up or log in to comment