protected AbstractTokenizer generateTokenizer ( ) { Class < ? extends AbstractTokenizer > tokenizer = parameters . getTokenizer ( ) ; if ( tokenizer == null ) { return null ; } try { return tokenizer . newInstance ( ) ; } catch ( InstantiationException | IllegalAccessException ex ) { throw new RuntimeException ( ex ) ; } }
Generates a new AbstractTokenizer object by using the provided tokenizer class .