Showing content from https://spark.apache.org/docs/latest/api/java/org/apache/spark/sql/EncoderImplicits.html below:
EncoderImplicits (Spark 4.0.0 JavaDoc)
newArrayEncoder <E> org.apache.spark.sql.catalyst.encoders.AgnosticEncoder<Object> newArrayEncoder(org.apache.spark.sql.catalyst.encoders.AgnosticEncoder<E> elementEncoder)
newBooleanArrayEncoder Encoder<boolean[]> newBooleanArrayEncoder
()
-
Since:
-
1.6.1
newBooleanEncoder
-
Since:
-
1.6.0
newBooleanSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newBooleanSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newBoxedBooleanEncoder
-
Since:
-
2.0.0
newBoxedByteEncoder
-
Since:
-
2.0.0
newBoxedDoubleEncoder
-
Since:
-
2.0.0
newBoxedFloatEncoder
-
Since:
-
2.0.0
newBoxedIntEncoder
-
Since:
-
2.0.0
newBoxedLongEncoder
-
Since:
-
2.0.0
newBoxedShortEncoder
-
Since:
-
2.0.0
newByteArrayEncoder Encoder<byte[]> newByteArrayEncoder
()
-
Since:
-
1.6.1
newByteEncoder
-
Since:
-
1.6.0
newByteSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newByteSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newDateEncoder
-
Since:
-
2.2.0
newDoubleArrayEncoder Encoder<double[]> newDoubleArrayEncoder
()
-
Since:
-
1.6.1
newDoubleEncoder
-
Since:
-
1.6.0
newDoubleSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newDoubleSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newDurationEncoder
-
Since:
-
3.2.0
newFloatArrayEncoder Encoder<float[]> newFloatArrayEncoder
()
-
Since:
-
1.6.1
newFloatEncoder
-
Since:
-
1.6.0
newFloatSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newFloatSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newInstantEncoder
-
Since:
-
3.0.0
newIntArrayEncoder Encoder<int[]> newIntArrayEncoder
()
-
Since:
-
1.6.1
newIntEncoder
-
Since:
-
1.6.0
newIntSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newIntSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newJavaDecimalEncoder
-
Since:
-
2.2.0
newJavaEnumEncoder <A extends Enum<?>> Encoder<A> newJavaEnumEncoder(scala.reflect.api.TypeTags.TypeTag<A> evidence$3)
-
Since:
-
3.2.0
newLocalDateEncoder
-
Since:
-
3.0.0
newLocalDateTimeEncoder
-
Since:
-
3.4.0
newLongArrayEncoder Encoder<long[]> newLongArrayEncoder
()
-
Since:
-
1.6.1
newLongEncoder
-
Since:
-
1.6.0
newLongSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newLongSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newMapEncoder <T extends scala.collection.Map<?, ?>> Encoder<T> newMapEncoder(scala.reflect.api.TypeTags.TypeTag<T> evidence$6)
-
Since:
-
2.3.0
newPeriodEncoder
-
Since:
-
3.2.0
newProductArrayEncoder <A extends scala.Product> Encoder<Object> newProductArrayEncoder(scala.reflect.api.TypeTags.TypeTag<A> evidence$8)
-
Since:
-
1.6.1
newProductSeqEncoder <A extends scala.Product> Encoder<scala.collection.immutable.Seq<A>> newProductSeqEncoder(scala.reflect.api.TypeTags.TypeTag<A> evidence$4)
-
Parameters:
-
evidence$4 - (undocumented)
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newScalaDecimalEncoder Encoder<scala.math.BigDecimal> newScalaDecimalEncoder
()
-
Since:
-
2.2.0
newSeqEncoder
<E> org.apache.spark.sql.catalyst.encoders.AgnosticEncoder<scala.collection.immutable.Seq<E>> newSeqEncoder(org.apache.spark.sql.catalyst.encoders.AgnosticEncoder<E> elementEncoder)
newSequenceEncoder <T extends scala.collection.immutable.Seq<Object>> Encoder<T> newSequenceEncoder(scala.reflect.api.TypeTags.TypeTag<T> evidence$5)
-
Since:
-
2.2.0
newSetEncoder <T extends scala.collection.immutable.Set<?>> Encoder<T> newSetEncoder(scala.reflect.api.TypeTags.TypeTag<T> evidence$7)
Notice that we serialize
Set
to Catalyst array. The set property is only kept when manipulating the domain objects. The serialization format doesn't keep the set property. When we have a Catalyst array which contains duplicated elements and convert it to
Dataset[Set[T}
by using the encoder, the elements will be de-duplicated.
-
Parameters:
-
evidence$7 - (undocumented)
-
Returns:
-
(undocumented)
-
Since:
-
2.3.0
newShortArrayEncoder Encoder<short[]> newShortArrayEncoder
()
-
Since:
-
1.6.1
newShortEncoder
-
Since:
-
1.6.0
newShortSeqEncoder Encoder<scala.collection.immutable.Seq<Object>> newShortSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newStringArrayEncoder
-
Since:
-
1.6.1
newStringEncoder
-
Since:
-
1.6.0
newStringSeqEncoder Encoder<scala.collection.immutable.Seq<String>> newStringSeqEncoder
()
-
Returns:
-
(undocumented)
-
Since:
-
1.6.1
newTimeStampEncoder
-
Since:
-
2.2.0
RetroSearch is an open source project built by @garambo
| Open a GitHub Issue
Search and Browse the WWW like it's 1997 | Search results from DuckDuckGo
HTML:
3.2
| Encoding:
UTF-8
| Version:
0.7.4