CpdLexerBase()
protected TokenManager<T>
filterTokenStream(TokenManager<T> tokenManager)
protected String
getImage(T token)
protected abstract TokenManager<T>
makeLexerImpl(TextDocument doc)
protected void
processToken(TokenFactory tokenEntries, T currentToken)
void
tokenize(TextDocument document, TokenFactory tokens)
Tokenize the source code and record tokens using the provided token factory.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4