Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from https://docs.pmd-code.org/apidocs/pmd-core/7.0.0-rc4/net/sourceforge/pmd/cpd/Tokenizer.html below:

Tokenizer (PMD Core 7.0.0-rc4 API)

• All Known Implementing Classes:

  AntlrTokenizer, AnyTokenizer, JavaCCTokenizer, TokenizerBase

  public interface Tokenizer

  Tokenizes a source file into tokens consumable by CPD.

• • Method Summary All Methods Static Methods Instance Methods Abstract Methods  Modifier and Type Method Description static void tokenize​(Tokenizer tokenizer, TextDocument textDocument, Tokens tokens)

    Wraps a call to

    tokenize(TextDocument, TokenFactory)

    to properly create and close the token factory.

    void tokenize​(TextDocument document, TokenFactory tokens)

    Tokenize the source code and record tokens using the provided token factory.

• • Method Detail
    • tokenize

      void tokenize​(TextDocument document,
                    TokenFactory tokens)
             throws IOException

      Tokenize the source code and record tokens using the provided token factory.

      Throws:

      IOException

    • tokenize

      static void tokenize​(Tokenizer tokenizer,
                           TextDocument textDocument,
                           Tokens tokens)
                    throws IOException

      Wraps a call to

      tokenize(TextDocument, TokenFactory)

      to properly create and close the token factory.

      Throws:

      IOException

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4