public interface TokenFactory<Symbol extends Token>
The default mechanism for creating tokens. It's used by default in Lexer and
the error handling strategy (to create missing tokens). Notifying the parser
of a new factory means that it notifies its token source and error strategy.
This is the method used to create tokens in the lexer and in the
error handling strategy. If text!=null, than the start and stop positions
are wiped to -1 in the text override is set in the CommonToken.