pyspark.ml.
PipelineModel
(stages: List[pyspark.ml.base.Transformer])¶
Represents a compiled pipeline with transformers and fitted models.
Methods
clear
(param)
Clears a param from the param map if it has been explicitly set.
copy
([extra])
Creates a copy of this instance.
explainParam
(param)
Explains a single param and returns its name, doc, and optional default value and user-supplied value in a string.
Returns the documentation of all params with their optionally default values and user-supplied values.
extractParamMap
([extra])
Extracts the embedded default param values and user-supplied values, and then merges them with extra values from input into a flat param map, where the latter value is used if there exist conflicts, i.e., with ordering: default param values < user-supplied values < extra.
getOrDefault
(param)
Gets the value of a param in the user-supplied param map or its default value.
getParam
(paramName)
Gets a param by its name.
hasDefault
(param)
Checks whether a param has a default value.
hasParam
(paramName)
Tests whether this instance contains a param with a given (string) name.
isDefined
(param)
Checks whether a param is explicitly set by user or has a default value.
isSet
(param)
Checks whether a param is explicitly set by user.
load
(path)
Reads an ML instance from the input path, a shortcut of read().load(path).
read
()
Returns an MLReader instance for this class.
save
(path)
Save this ML instance to the given path, a shortcut of âwrite().save(path)â.
set
(param, value)
Sets a parameter in the embedded param map.
transform
(dataset[, params])
Transforms the input dataset with optional parameters.
write
()
Returns an MLWriter instance for this ML instance.
Attributes
Returns all params ordered by name.
Methods Documentation
clear
(param: pyspark.ml.param.Param) → None¶
Clears a param from the param map if it has been explicitly set.
copy
(extra: Optional[ParamMap] = None) → PipelineModel¶
Creates a copy of this instance.
extra â extra parameters
new instance
explainParam
(param: Union[str, pyspark.ml.param.Param]) → str¶
Explains a single param and returns its name, doc, and optional default value and user-supplied value in a string.
explainParams
() → str¶
Returns the documentation of all params with their optionally default values and user-supplied values.
Extracts the embedded default param values and user-supplied values, and then merges them with extra values from input into a flat param map, where the latter value is used if there exist conflicts, i.e., with ordering: default param values < user-supplied values < extra.
extra param values
merged param map
getOrDefault
(param: Union[str, pyspark.ml.param.Param[T]]) → Union[Any, T]¶
Gets the value of a param in the user-supplied param map or its default value. Raises an error if neither is set.
getParam
(paramName: str) → pyspark.ml.param.Param¶
Gets a param by its name.
hasDefault
(param: Union[str, pyspark.ml.param.Param[Any]]) → bool¶
Checks whether a param has a default value.
hasParam
(paramName: str) → bool¶
Tests whether this instance contains a param with a given (string) name.
isDefined
(param: Union[str, pyspark.ml.param.Param[Any]]) → bool¶
Checks whether a param is explicitly set by user or has a default value.
isSet
(param: Union[str, pyspark.ml.param.Param[Any]]) → bool¶
Checks whether a param is explicitly set by user.
load
(path: str) → RL¶
Reads an ML instance from the input path, a shortcut of read().load(path).
read
() → pyspark.ml.pipeline.PipelineModelReader¶
Returns an MLReader instance for this class.
save
(path: str) → None¶
Save this ML instance to the given path, a shortcut of âwrite().save(path)â.
set
(param: pyspark.ml.param.Param, value: Any) → None¶
Sets a parameter in the embedded param map.
transform
(dataset: pyspark.sql.dataframe.DataFrame, params: Optional[ParamMap] = None) → pyspark.sql.dataframe.DataFrame¶
Transforms the input dataset with optional parameters.
pyspark.sql.DataFrame
input dataset
an optional param map that overrides embedded params.
pyspark.sql.DataFrame
transformed dataset
write
() → pyspark.ml.util.MLWriter¶
Returns an MLWriter instance for this ML instance.
Attributes Documentation
params
¶
Returns all params ordered by name. The default implementation uses dir()
to get all attributes of type Param
.
RetroSearch is an open source project built by @garambo | Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4