Revisions of spark
Johannes Grassler (jgrassler)
accepted
request 691813
from
Joseph Davis (joadavis)
(revision 38)
- Add fix-spark-home-and-conf.patch The patch fixes SPARK_HOME and SPARK_CONF_DIR in the different bin/spark-* scripts to call find-spark-home.
Dirk Mueller (dirkmueller)
accepted
request 686139
from
Joseph Davis (joadavis)
(revision 37)
- Add metrics-core-2.2.0.jar and kafka_2.10-0.8.2.1.jar to dist/jars - Note these version changes must match up with the spark-kit package, and that upstream OpenStack Monasca Transform is using Scala 2.10 and Kafka 0.8. - Changed spark-streaming-kafka to 0.8-2.10 and changed copied file name to include versions - Changed Scala version in .jar filename to 2.10 to match build.sh - Modified build.sh to build against Scala 2.10
Johannes Grassler (jgrassler)
committed
(revision 36)
osc copypac from project:Cloud:OpenStack:Rocky package:spark revision:7, using keep-link, using expand
Thomas Bechtold (tbechtold)
accepted
request 676575
from
Johannes Grassler (jgrassler)
(revision 35)
Note: this requires https://build.opensuse.org/request/show/676573 to build. - Update to version 2.2.3 * [SPARK-26327] - Metrics in FileSourceScanExec not update correctly while relation.partitionSchema is set * [SPARK-21402] - Fix java array of structs deserialization * [SPARK-22951] - count() after dropDuplicates() on emptyDataFrame returns incorrect value * [SPARK-23207] - Shuffle+Repartition on an DataFrame could lead to incorrect * answers * [SPARK-23243] - Shuffle+Repartition on an RDD could lead to incorrect answers * [SPARK-24603] - Typo in comments * [SPARK-24677] - TaskSetManager not updating successfulTaskDurations for old stage attempts * [SPARK-24809] - Serializing LongHashedRelation in executor may result in data error * [SPARK-24813] - HiveExternalCatalogVersionsSuite still flaky; fall back to Apache archive * [SPARK-24927] - The hadoop-provided profile doesn't play well with Snappy-compressed Parquet files * [SPARK-24948] - SHS filters wrongly some applications due to permission check * [SPARK-24950] - scala DateTimeUtilsSuite daysToMillis and millisToDays fails w/java 8 181-b13 * [SPARK-24957] - Decimal arithmetic can lead to wrong values using codegen * [SPARK-25081] - Nested spill in ShuffleExternalSorter may access a released memory page * [SPARK-25114] - RecordBinaryComparator may return wrong result when subtraction between two words is divisible by Integer.MAX_VALUE * [SPARK-25144] - distinct on Dataset leads to exception due to Managed
Joseph Davis (joadavis)
accepted
request 673429
from
Ashwin Agate (aagate)
(revision 34)
- Added Restart and RestartSec to restart spark master and spark worker (bsc#1091479)
Thomas Bechtold (tbechtold)
accepted
request 590361
from
Ashwin Agate (aagate)
(revision 33)
- Remove drizzle jdbc jar (bsc#1084084)
Dirk Mueller (dirkmueller)
accepted
request 589793
from
Ashwin Agate (aagate)
(revision 32)
- Remove drizzle jdbc jar
Thomas Bechtold (tbechtold)
committed
(revision 31)
- Add fix-spark-home-and-conf.patch The patch fixes SPARK_HOME and SPARK_CONF_DIR in the different bin/spark-* scripts. - Added SPARK_DAEMON_JAVA_OPTS to set java heap size settings in spark-worker and spark-master service files.
Dirk Mueller (dirkmueller)
accepted
request 583860
from
Thomas Bechtold (tbechtold)
(revision 30)
- Install /etc/spark/spark-env . This script is automatically read during startup and can be used for custom configuration - Install /etc/spark/spark-defaults.conf - Create /run/spark dir via systemd tmpfiles - Add missing Requires/BuildRequires for systemd - Drop openstack-suse-macros BuildRequires and use the typical way to create a spark user/group and homedir - Add useful description
Dirk Mueller (dirkmueller)
committed
(revision 29)
- cleanup spec file
Joseph Davis (joadavis)
committed
(revision 28)
Joseph Davis (joadavis)
committed
(revision 27)
Joseph Davis (joadavis)
committed
(revision 26)
Joseph Davis (joadavis)
committed
(revision 25)
Thomas Bechtold (tbechtold)
committed
(revision 24)
- Fix ExecStartPre bash syntax in spark-worker.service (bsc#1081275)
Jonathan Brownell (jbrownell)
committed
(revision 23)
Jonathan Brownell (jbrownell)
committed
(revision 22)
Jonathan Brownell (jbrownell)
committed
(revision 21)
Jonathan Brownell (jbrownell)
committed
(revision 20)
Jonathan Brownell (jbrownell)
committed
(revision 19)
Displaying revisions 1 - 20 of 38