Revisions of spark

Johannes Grassler's avatar Johannes Grassler (jgrassler) accepted request 691813 from Joseph Davis's avatar Joseph Davis (joadavis) (revision 38)
- Add fix-spark-home-and-conf.patch
  The patch fixes SPARK_HOME and SPARK_CONF_DIR in the different
  bin/spark-* scripts to call find-spark-home.
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 686139 from Joseph Davis's avatar Joseph Davis (joadavis) (revision 37)
- Add metrics-core-2.2.0.jar and kafka_2.10-0.8.2.1.jar to dist/jars 
- Note these version changes must match up with the spark-kit 
  package, and that upstream OpenStack Monasca Transform is using
  Scala 2.10 and Kafka 0.8.
- Changed spark-streaming-kafka to 0.8-2.10
  and changed copied file name to include versions
- Changed Scala version in .jar filename to 2.10 to match build.sh
- Modified build.sh to build against Scala 2.10 
Johannes Grassler's avatar Johannes Grassler (jgrassler) committed (revision 36)
osc copypac from project:Cloud:OpenStack:Rocky package:spark revision:7, using keep-link, using expand
Thomas Bechtold's avatar Thomas Bechtold (tbechtold) accepted request 676575 from Johannes Grassler's avatar Johannes Grassler (jgrassler) (revision 35)
Note: this requires https://build.opensuse.org/request/show/676573 to build.

- Update to version 2.2.3
  * [SPARK-26327] - Metrics in FileSourceScanExec not update correctly while
                    relation.partitionSchema is set
  * [SPARK-21402] - Fix java array of structs deserialization
  * [SPARK-22951] - count() after dropDuplicates() on emptyDataFrame returns
                    incorrect value
  * [SPARK-23207] - Shuffle+Repartition on an DataFrame could lead to incorrect
  *                 answers
  * [SPARK-23243] - Shuffle+Repartition on an RDD could lead to incorrect
                    answers
  * [SPARK-24603] - Typo in comments
  * [SPARK-24677] - TaskSetManager not updating successfulTaskDurations for old
                    stage attempts
  * [SPARK-24809] - Serializing LongHashedRelation in executor may result in
                    data error
  * [SPARK-24813] - HiveExternalCatalogVersionsSuite still flaky; fall back to
                    Apache archive
  * [SPARK-24927] - The hadoop-provided profile doesn't play well with
                    Snappy-compressed Parquet files
  * [SPARK-24948] - SHS filters wrongly some applications due to permission
                    check
  * [SPARK-24950] - scala DateTimeUtilsSuite daysToMillis and millisToDays
                    fails w/java 8 181-b13
  * [SPARK-24957] - Decimal arithmetic can lead to wrong values using codegen
  * [SPARK-25081] - Nested spill in ShuffleExternalSorter may access a released
                    memory page
  * [SPARK-25114] - RecordBinaryComparator may return wrong result when
                    subtraction between two words is divisible by
                    Integer.MAX_VALUE
  * [SPARK-25144] - distinct on Dataset leads to exception due to Managed
Joseph Davis's avatar Joseph Davis (joadavis) accepted request 673429 from Ashwin Agate's avatar Ashwin Agate (aagate) (revision 34)
- Added Restart and RestartSec to restart 
  spark master and spark worker (bsc#1091479)
Thomas Bechtold's avatar Thomas Bechtold (tbechtold) accepted request 590361 from Ashwin Agate's avatar Ashwin Agate (aagate) (revision 33)
- Remove drizzle jdbc jar (bsc#1084084)
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 589793 from Ashwin Agate's avatar Ashwin Agate (aagate) (revision 32)
- Remove drizzle jdbc jar
Thomas Bechtold's avatar Thomas Bechtold (tbechtold) committed (revision 31)
- Add fix-spark-home-and-conf.patch
  The patch fixes SPARK_HOME and SPARK_CONF_DIR in the different
  bin/spark-* scripts.

- Added SPARK_DAEMON_JAVA_OPTS to set java heap size
  settings in spark-worker and spark-master service
  files.
Dirk Mueller's avatar Dirk Mueller (dirkmueller) accepted request 583860 from Thomas Bechtold's avatar Thomas Bechtold (tbechtold) (revision 30)
- Install /etc/spark/spark-env . This script is automatically
  read during startup and can be used for custom configuration
- Install /etc/spark/spark-defaults.conf
- Create /run/spark dir via systemd tmpfiles
- Add missing Requires/BuildRequires for systemd
- Drop openstack-suse-macros BuildRequires and use the typical
  way to create a spark user/group and homedir
- Add useful description
Dirk Mueller's avatar Dirk Mueller (dirkmueller) committed (revision 29)
- cleanup spec file
Joseph Davis's avatar Joseph Davis (joadavis) committed (revision 28)
Joseph Davis's avatar Joseph Davis (joadavis) committed (revision 27)
Joseph Davis's avatar Joseph Davis (joadavis) committed (revision 26)
Joseph Davis's avatar Joseph Davis (joadavis) committed (revision 25)
Thomas Bechtold's avatar Thomas Bechtold (tbechtold) committed (revision 24)
- Fix ExecStartPre bash syntax in spark-worker.service (bsc#1081275)
Jonathan Brownell's avatar Jonathan Brownell (jbrownell) committed (revision 23)
Jonathan Brownell's avatar Jonathan Brownell (jbrownell) committed (revision 22)
Jonathan Brownell's avatar Jonathan Brownell (jbrownell) committed (revision 21)
Jonathan Brownell's avatar Jonathan Brownell (jbrownell) committed (revision 20)
Jonathan Brownell's avatar Jonathan Brownell (jbrownell) committed (revision 19)
Displaying revisions 1 - 20 of 38
openSUSE Build Service is sponsored by