Home - News ( United States | United Kingdom | Italy | Germany ) - Football scores

Showing content from http://spark.apache.org/docs/latest/api/java/org/apache/spark/ml/feature/HashingTF.html below:

HashingTF (Spark 4.0.0 JavaDoc)

All Implemented Interfaces:

Serializable, org.apache.spark.internal.Logging, Params, HasInputCol, HasNumFeatures, HasOutputCol, DefaultParamsWritable, Identifiable, MLWritable

Maps a sequence of terms to their term frequencies using the hashing trick. Currently we use Austin Appleby's MurmurHash 3 algorithm (MurmurHash3_x86_32) to calculate the hash code value for the term object. Since a simple modulo is used to transform the hash function to a column index, it is advisable to use a power of two as the numFeatures parameter; otherwise the features will not be mapped evenly to the columns.

See Also:

• Serialized Form

• Nested Class Summary
  Nested classes/interfaces inherited from interface org.apache.spark.internal.Loggingorg.apache.spark.internal.Logging.LogStringContext, org.apache.spark.internal.Logging.SparkShellLoggingFilter

• Constructor Summary

  Constructors

• Method Summary

  Binary toggle to control term frequency counts.

  Creates a copy of this instance with the same UID and some extra params.

  boolean

  int

  int

  Returns the index of the input term.

  Param for input column name.

  Param for Number of features.

  Param for output column name.

  void

  Saves this ML instance to the input path, a shortcut of write.save(path).

  Transforms the input dataset.

  Check transform validity and derive the output schema from the input schema.

  An immutable unique ID for the object and its derivatives.

  Methods inherited from interface org.apache.spark.internal.LogginginitializeForcefully, initializeLogIfNecessary, initializeLogIfNecessary, initializeLogIfNecessary$default$2, isTraceEnabled, log, logDebug, logDebug, logDebug, logDebug, logError, logError, logError, logError, logInfo, logInfo, logInfo, logInfo, logName, LogStringContext, logTrace, logTrace, logTrace, logTrace, logWarning, logWarning, logWarning, logWarning, org$apache$spark$internal$Logging$$log_, org$apache$spark$internal$Logging$$log__$eq, withLogContext
  Methods inherited from interface org.apache.spark.ml.param.Paramsclear, copyValues, defaultCopy, defaultParamMap, explainParam, explainParams, extractParamMap, extractParamMap, get, getDefault, getOrDefault, getParam, hasDefault, hasParam, isDefined, isSet, onParamChange, paramMap, params, set, set, set, setDefault, setDefault, shouldOwn

• Constructor Details
  • HashingTF

    public HashingTF()

  • HashingTF
• Method Details
  • read
  • load
  • numFeatures

    Param for Number of features. Should be greater than 0.

    Specified by:

    numFeatures in interface HasNumFeatures

    Returns:

    (undocumented)

  • outputCol

    Param for output column name.

    Specified by:

    outputCol in interface HasOutputCol

    Returns:

    (undocumented)

  • inputCol

    Param for input column name.

    Specified by:

    inputCol in interface HasInputCol

    Returns:

    (undocumented)

  • uid

    An immutable unique ID for the object and its derivatives.

    Specified by:

    uid in interface Identifiable

    Returns:

    (undocumented)

  • hashFuncVersion

    public int hashFuncVersion()

  • setInputCol
  • setOutputCol
  • binary

    Binary toggle to control term frequency counts. If true, all non-zero counts are set to 1. This is useful for discrete probabilistic models that model binary events rather than integer counts. (default = false)

    Returns:

    (undocumented)

  • setNumFeatures
  • getBinary

    public boolean getBinary()

  • setBinary
  • transform

    Transforms the input dataset.

    Specified by:

    transform in class Transformer

    Parameters:

    dataset - (undocumented)

    Returns:

    (undocumented)

  • transformSchema

    Check transform validity and derive the output schema from the input schema.

    We check validity for interactions between parameters during transformSchema and raise an exception if any parameter value is invalid. Parameter value checks which do not depend on other parameters are handled by Param.validate().

    Typical implementation should first conduct verification on schema change and parameter validity, including complex parameter interaction checks.

    Specified by:

    transformSchema in class PipelineStage

    Parameters:

    schema - (undocumented)

    Returns:

    (undocumented)

  • indexOf public int indexOf(Object term)

    Returns the index of the input term.

    Parameters:

    term - (undocumented)

    Returns:

    (undocumented)

  • copy Description copied from interface: Params

    Creates a copy of this instance with the same UID and some extra params. Subclasses should implement this method and set the return type properly. See defaultCopy().

    Specified by:

    copy in interface Params

    Specified by:

    copy in class Transformer

    Parameters:

    extra - (undocumented)

    Returns:

    (undocumented)

  • toString

    Specified by:

    toString in interface Identifiable

    Overrides:

    toString in class Object

  • save

    Saves this ML instance to the input path, a shortcut of write.save(path).

    Specified by:

    save in interface MLWritable

    Parameters:

    path - (undocumented)

RetroSearch is an open source project built by @garambo | Open a GitHub Issue

Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo

HTML: 3.2 | Encoding: UTF-8 | Version: 0.7.4