Apache Spark

Edit Package spark
No description set
Refresh
Refresh
Source Files
Filename Size Changed
_service 0000000408 408 Bytes
build.sh 0000002149 2.1 KB
spark-2.2.3.tgz 0014191977 13.5 MB
spark-master.service 0000000346 346 Bytes
spark-tmpfiles.conf 0000000069 69 Bytes
spark-worker.service 0000000387 387 Bytes
spark.changes 0000005838 5.7 KB
spark.spec 0000006069 5.93 KB
Revision 35 (latest revision is 38)
Thomas Bechtold's avatar Thomas Bechtold (tbechtold) accepted request 676575 from Johannes Grassler's avatar Johannes Grassler (jgrassler) (revision 35)
Note: this requires https://build.opensuse.org/request/show/676573 to build.

- Update to version 2.2.3
  * [SPARK-26327] - Metrics in FileSourceScanExec not update correctly while
                    relation.partitionSchema is set
  * [SPARK-21402] - Fix java array of structs deserialization
  * [SPARK-22951] - count() after dropDuplicates() on emptyDataFrame returns
                    incorrect value
  * [SPARK-23207] - Shuffle+Repartition on an DataFrame could lead to incorrect
  *                 answers
  * [SPARK-23243] - Shuffle+Repartition on an RDD could lead to incorrect
                    answers
  * [SPARK-24603] - Typo in comments
  * [SPARK-24677] - TaskSetManager not updating successfulTaskDurations for old
                    stage attempts
  * [SPARK-24809] - Serializing LongHashedRelation in executor may result in
                    data error
  * [SPARK-24813] - HiveExternalCatalogVersionsSuite still flaky; fall back to
                    Apache archive
  * [SPARK-24927] - The hadoop-provided profile doesn't play well with
                    Snappy-compressed Parquet files
  * [SPARK-24948] - SHS filters wrongly some applications due to permission
                    check
  * [SPARK-24950] - scala DateTimeUtilsSuite daysToMillis and millisToDays
                    fails w/java 8 181-b13
  * [SPARK-24957] - Decimal arithmetic can lead to wrong values using codegen
  * [SPARK-25081] - Nested spill in ShuffleExternalSorter may access a released
                    memory page
  * [SPARK-25114] - RecordBinaryComparator may return wrong result when
                    subtraction between two words is divisible by
                    Integer.MAX_VALUE
  * [SPARK-25144] - distinct on Dataset leads to exception due to Managed
Comments 2

Joseph Davis's avatar

Spark-master.service should run on 7077, while spark-worker.service should stay on 7078


Joseph Davis's avatar

Thanks for pulling in the 2.2.3 update, Dirk

openSUSE Build Service is sponsored by