public static String clear ( String text ) { text = StringCleaner . tokenizeURLs ( text ) ; text = StringCleaner . tokenizeSmileys ( text ) ; text = StringCleaner . removeAccents ( text ) ; text = StringCleaner . removeSymbols ( text ) ; text = StringCleaner . removeExtraSpaces ( text ) ; return text . toLowerCase ( Locale . ENGLISH ) ; }
Convenience method which tokenizes the URLs and the SMILEYS_MAPPING removes accents and symbols and eliminates the extra spaces from the provided text .