Google Git
Sign in
apache / spark / refs/heads/branch-0.9 / . / CHANGES.txt
blob: 63069639b7b96306319a91defc5a9311897fe5f9 [file] [log] [blame]
Spark Change Log
----------------
Release 0.9.2
[branch-0.9] bump versions for v0.9.2 release candidate
Xiangrui Meng <meng@databricks.com>
2014-07-16 23:53:40 -0700
Commit: c9a22e8, github.com/apache/spark/pull/1458
[branch-0.9] Fix github links in docs
Xiangrui Meng <meng@databricks.com>
2014-07-16 23:39:02 -0700
Commit: 60f4b3b, github.com/apache/spark/pull/1456
[SPARK-1112, 2156] (0.9 edition) Use correct akka frame size and overhead amounts.
Patrick Wendell <pwendell@gmail.com>
2014-07-16 21:30:50 -0700
Commit: 7edee34, github.com/apache/spark/pull/1455
[SPARK-2433][MLLIB] fix NaiveBayesModel.predict
Xiangrui Meng <meng@databricks.com>
2014-07-16 20:12:09 -0700
Commit: 0116dee, github.com/apache/spark/pull/1453
[SPARK-2362] Fix for newFilesOnly logic in file DStream
Gabriele Nizzoli <mail@nizzoli.net>
2014-07-08 14:23:38 -0700
Commit: 8e5604b, github.com/apache/spark/pull/1077
SPARK-2282: Reuse PySpark Accumulator sockets to avoid crashing Spark
Aaron Davidson <aaron@databricks.com>
2014-07-03 23:02:36 -0700
Commit: 57873ef, github.com/apache/spark/pull/1220
[SPARK-2350] Don't NPE while launching drivers
Aaron Davidson <aaron@databricks.com>
2014-07-03 22:31:41 -0700
Commit: c37e9ed, github.com/apache/spark/pull/1289
[SPARK-1516]Throw exception in yarn client instead of run system.exit
John Zhao <codeboyyong@gmail.com>
2014-07-03 15:17:51 -0700
Commit: 0d3d5ce, github.com/apache/spark/pull/1099
HOTFIX: Removing out dated python path in testing tool.
Patrick Wendell <pwendell@gmail.com>
2014-06-27 18:19:16 -0700
Commit: b3f4245
[SPARK-1912] fix compress memory issue during reduce
Wenchen Fan(Cloud) <cloud0fan@gmail.com>
2014-06-03 13:18:20 -0700
Commit: 9509819, github.com/apache/spark/pull/860
SPARK-2241: quote command line args in ec2 script
Ori Kremer <ori.kremer@gmail.com>
2014-06-22 20:21:23 -0700
Commit: ef8501d, github.com/apache/spark/pull/1169
HOTFIX: bug caused by #941
Patrick Wendell <pwendell@gmail.com>
2014-06-17 15:09:24 -0700
Commit: 2a2eace, github.com/apache/spark/pull/1108
SPARK-1990: added compatibility for python 2.6 for ssh_read command
Anant <anant.asty@gmail.com>
2014-06-16 23:42:27 -0700
Commit: 8e9f479, github.com/apache/spark/pull/941
[SPARK-1998] SparkFlumeEvent with body bigger than 1020 bytes are not re...
joyyoj <sunshch@gmail.com>
2014-06-10 17:26:17 -0700
Commit: 706e38f, github.com/apache/spark/pull/951
Spark 1384 - Fix spark-shell on yarn access to secure hdfs - branch-0.9 only
Thomas Graves <tgraves@apache.org>
2014-06-09 23:07:25 -0700
Commit: cc95d97, github.com/apache/spark/pull/287
[SPARK-1870] Made deployment with --jars work in yarn-standalone mode.
DB Tsai <dbtsai@dbtsai.com>
2014-06-09 22:56:24 -0700
Commit: 1d3aab9, github.com/apache/spark/pull/1013
SPARK-2043: ExternalAppendOnlyMap doesn't always find matching keys
Matei Zaharia <matei@databricks.com>
2014-06-05 23:01:48 -0700
Commit: 51f677e, github.com/apache/spark/pull/986
SPARK-1790: Update EC2 scripts to support r3 instance types
Varakhedi Sujeet <svarakhedi@gopivotal.com>
2014-06-04 16:01:56 -0700
Commit: 6634a34, github.com/apache/spark/pull/960
[SPARK-1468] Modify the partition function used by partitionBy.
Erik Selin <erik.selin@jadedpixel.com>
2014-06-03 13:31:16 -0700
Commit: 41e7853, github.com/apache/spark/pull/371
SPARK-1917: fix PySpark import of scipy.special functions
Uri Laserson <laserson@cloudera.com>
2014-05-31 14:59:09 -0700
Commit: e03af41, github.com/apache/spark/pull/866
SPARK-1935: Explicitly add commons-codec 1.5 as a dependency (for branch-0.9).
Yin Huai <huai@cse.ohio-state.edu>
2014-05-30 22:12:17 -0700
Commit: 563bfe1, github.com/apache/spark/pull/912
SPARK-1188: Do not re-use objects in the EdgePartition/EdgeTriplet iterators.
Daniel Darabos <darabos.daniel@gmail.com>
2014-04-02 12:27:37 -0700
Commit: a92900c, github.com/apache/spark/pull/276
[SPARK-1712]: TaskDescription instance is too big causes Spark to hang
witgo <witgo@qq.com>
2014-05-28 15:57:05 -0700
Commit: aef6390, github.com/apache/spark/pull/694
Spark 1916
David Lemieux <david.lemieux@radialpoint.com>
2014-05-28 15:50:35 -0700
Commit: 234a378, github.com/apache/spark/pull/865
SPARK-1145: Memory mapping with many small blocks can cause JVM allocation failures
Patrick Wendell <pwendell@gmail.com>
2014-04-27 17:40:56 -0700
Commit: 7633949, github.com/apache/spark/pull/43
Update version to 0.9.2-SNAPSHOT in sbt
Matei Zaharia <matei@databricks.com>
2014-05-11 16:54:54 -0700
Commit: c9f40d0
SPARK-1775: Unneeded lock in ShuffleMapTask.deserializeInfo
Sandeep <sandeep@techaddict.me>
2014-05-08 22:30:17 -0700
Commit: bea2be3, github.com/apache/spark/pull/707
[SPARK-1685] Cancel retryTimer on restart of Worker or AppClient
Mark Hamstra <markhamstra@gmail.com>
2014-05-06 12:53:39 -0700
Commit: 9e2c59e, github.com/apache/spark/pull/602
[WIP] SPARK-1676: Cache Hadoop UGIs by default to prevent FileSystem leak
Thomas Graves <tgraves@apache.org>
2014-05-03 10:59:05 -0700
Commit: 45561cd, github.com/apache/spark/pull/621
version number fix
Nan Zhu <CodingCat@users.noreply.github.com>
2014-04-21 23:42:47 -0700
Commit: 54c3b7e, github.com/apache/spark/pull/467
Small syntax error from previous backport
Patrick Wendell <pwendell@gmail.com>
2014-04-13 14:32:22 -0700
Commit: 9e89789
Update WindowedDStream.scala
baishuo(白硕) <vc_java@hotmail.com>
2014-04-11 20:33:42 -0700
Commit: 4a325e1, github.com/apache/spark/pull/390
Fixed typo on Spark quick-start docs.
Tathagata Das <tathagata.das1565@gmail.com>
2014-04-07 18:27:46 -0700
Commit: 19cf2f7
SPARK-1432: Make sure that all metadata fields are properly cleaned
Davis Shepherd <davis@conviva.com>
2014-04-07 10:02:00 -0700
Commit: 69fc97d, github.com/apache/spark/pull/338
SPARK-1421. Make MLlib work on Python 2.6
Matei Zaharia <matei@databricks.com>
2014-04-05 20:52:05 -0700
Commit: 139fc1a, github.com/apache/spark/pull/335
Update documentation for work around for SPARK-1384
Thomas Graves <tgraves@apache.org>
2014-04-04 18:26:51 -0700
Commit: d4df076, github.com/apache/spark/pull/314
SPARK-1337: Application web UI garbage collects newest stages
Patrick Wendell <pwendell@gmail.com>
2014-04-03 22:13:56 -0700
Commit: 7f727cf, github.com/apache/spark/pull/320
[SPARK-1134] Fix and document passing of arguments to IPython
Diana Carroll <dcarroll@cloudera.com>
2014-04-03 15:48:42 -0700
Commit: d9c7a80, github.com/apache/spark/pull/294
Spark 1162 Implemented takeOrdered in pyspark.
Prashant Sharma <prashant.s@imaginea.com>
2014-04-03 15:42:17 -0700
Commit: 28e7643, github.com/apache/spark/pull/97
fix path for jar, make sed actually work on OSX
Nick Lanham <nick@afternight.org>
2014-03-28 13:33:35 -0700
Commit: a6c955a, github.com/apache/spark/pull/264
Make sed do -i '' on OSX
Nick Lanham <nick@afternight.org>
2014-03-27 22:45:00 -0700
Commit: 4afbd19, github.com/apache/spark/pull/258
Release 0.9.1
Revert "[maven-release-plugin] prepare release v0.9.1-rc2"
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-26 21:53:07 -0700
Commit: ea5da04
Revert "[maven-release-plugin] prepare for next development iteration"
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-26 21:51:40 -0700
Commit: d16e863
[SPARK-1327] GLM needs to check addIntercept for intercept and weights
Xiangrui Meng <meng@databricks.com>
2014-03-26 19:30:57 -0700
Commit: 4901604, github.com/apache/spark/pull/236
SPARK-1322, top in pyspark should sort result in descending order.
Prashant Sharma <prashant.s@imaginea.com>
2014-03-26 11:15:02 -0700
Commit: 2f90dc5, github.com/apache/spark/pull/235
[maven-release-plugin] prepare for next development iteration
Ubuntu <ubuntu@ip-172-31-18-245.us-west-2.compute.internal>
2014-03-26 09:26:45 +0000
Commit: 1f785d4
[maven-release-plugin] prepare release v0.9.1-rc2
Ubuntu <ubuntu@ip-172-31-18-245.us-west-2.compute.internal>
2014-03-26 09:26:40 +0000
Commit: 1197280
Updated CHANGES.txt
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-26 02:10:57 -0700
Commit: 7495dba
[SPARK-782] Made Spark use existing shaded ASM and removed Spark's ASM dependency
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-25 21:35:36 -0700
Commit: da87240, github.com/apache/spark/pull/232
Revert "[maven-release-plugin] prepare release v0.9.1-rc1"
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-25 15:01:52 -0700
Commit: 55abe72
Revert "[maven-release-plugin] prepare for next development iteration"
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-25 15:01:36 -0700
Commit: b94f997
[maven-release-plugin] prepare for next development iteration
Ubuntu <ubuntu@ip-172-31-18-245.us-west-2.compute.internal>
2014-03-24 06:56:16 +0000
Commit: 12e237e
[maven-release-plugin] prepare release v0.9.1-rc1
Ubuntu <ubuntu@ip-172-31-18-245.us-west-2.compute.internal>
2014-03-24 06:56:10 +0000
Commit: 81c6a06
Removed all occurences of incubator from all the pom.xml.
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-23 23:31:59 -0700
Commit: 60ddb34
Updated CHANGES.txt file.
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-23 13:16:50 -0700
Commit: f176b03
Fix to Stage UI to display numbers on progress bar
Emtiaz Ahmed <emtiazahmed@gmail.com>
2014-03-21 18:07:05 -0700
Commit: 5e7ac0d, github.com/apache/spark/pull/201
SPARK-1284: Fix improper use of SimpleDateFormat
zsxwing <zsxwing@gmail.com>
2014-03-21 16:39:23 -0700
Commit: 8856076, github.com/apache/spark/pull/179
[SPARK-1273] use doi links in mllib-guide
Xiangrui Meng <meng@databricks.com>
2014-03-21 14:35:32 -0700
Commit: d68549e, github.com/apache/spark/pull/198
Removed incubating from Spark version in all the pom.xml.
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-20 18:02:55 -0700
Commit: 8b1e793
Bumped versions to Spark 0.9.1
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-20 16:55:35 -0700
Commit: 8a882ef, github.com/apache/spark/pull/190
SPARK-1032. If Yarn app fails before registering, app master stays aroun...
Sandy Ryza <sandy@cloudera.com>
2014-03-20 16:50:44 -0500
Commit: c6630d3, github.com/apache/spark/pull/28
SPARK-1051. On YARN, executors don't doAs submitting user
Sandy Ryza <sandy@cloudera.com>
2014-03-20 14:48:05 -0500
Commit: 748f002, github.com/apache/spark/pull/29
[SPARK-1285] Backporting updates to streaming docs to branch 0.9
Aaron Kimball <aaron@magnify.io>, Tathagata Das <tathagata.das1565@gmail.com>, Chen Chao <crazyjvm@gmail.com>, Andrew Or <andrewor14@gmail.com>
2014-03-20 12:27:47 -0700
Commit: 1e36690, github.com/apache/spark/pull/183
[SPARK-1273] MLlib bug fixes, improvements, and doc updates for v0.9.1
Xiangrui Meng <meng@databricks.com>, Sean Owen <sowen@cloudera.com>, Andrew Tulloch <andrew@tullo.ch>, Chen Chao <crazyjvm@gmail.com>
2014-03-19 19:05:26 -0700
Commit: 1cc979e, github.com/apache/spark/pull/175
[SPARK-1275] Made dev/run-tests executable.
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-19 16:10:45 -0700
Commit: a4eef65, github.com/apache/spark/pull/178
Update the yarn alpha version to 0.9.1-incubating-SNAPSHOT
Thomas Graves <tgraves@apache.org>
2014-03-19 12:41:11 -0500
Commit: 72875b2
SPARK-1203 fix saving to hdfs from yarn
Thomas Graves <tgraves@apache.org>
2014-03-19 08:19:47 -0500
Commit: 250ec27, github.com/apache/spark/pull/173
bugfix: Wrong "Duration" in "Active Stages" in stages page
shiyun.wxm <shiyun.wxm@taobao.com>
2014-03-19 01:42:42 -0700
Commit: d385b5a, github.com/apache/spark/pull/170
[SPARK-1274] Add dev scripts to merge PRs and create releases from master to branch-0.9
Tathagata Das <tathagata.das1565@gmail.com>
2014-03-18 22:09:16 -0700
Commit: 7ec78bc, github.com/apache/spark/pull/176
Bundle tachyon: SPARK-1269
Nick Lanham <nick@afternight.org>
2014-03-18 22:05:18 -0700
Commit: 0183ddd, github.com/apache/spark/pull/137
[Spark-1261] add instructions for running python examples to doc overview page
Diana Carroll <dcarroll@cloudera.com>
2014-03-17 17:37:03 -0700
Commit: 20d9458, github.com/apache/spark/pull/162
SPARK-1244: Throw exception if map output status exceeds frame size
Patrick Wendell <pwendell@gmail.com>, Andrew Or <andrewor14@gmail.com>
2014-03-17 14:06:28 -0700
Commit: 4562140, github.com/apache/spark/pull/152
SPARK-1240: handle the case of empty RDD when takeSample
CodingCat <zhunansjtu@gmail.com>
2014-03-16 22:40:22 -0700
Commit: af7e8b1, github.com/apache/spark/pull/135
SPARK-977 Added Python RDD.zip function
Prabin Banka <prabin.banka@imaginea.com>
2014-03-16 22:16:17 -0700
Commit: 1dc1e98, github.com/apache/spark/pull/76
Spark-1163, Added missing Python RDD functions
prabinb <prabin.banka@imaginea.com>
2014-03-16 22:14:53 -0700
Commit: 249930a, github.com/apache/spark/pull/92
SPARK-1168, Added foldByKey to pyspark.
Prashant Sharma <prashant.s@imaginea.com>
2014-03-16 22:13:33 -0700
Commit: 4480505, github.com/apache/spark/pull/115
Updated link for pyspark examples in docs
Jyotiska NK <jyotiska123@gmail.com>
2014-03-16 22:12:51 -0700
Commit: e74e79a, github.com/apache/spark/pull/22
SPARK-1019: pyspark RDD take() throws an NPE
Patrick Wendell <pwendell@gmail.com>
2014-03-12 23:17:17 -0700
Commit: ef74e44, github.com/apache/spark/pull/112
Fix example bug: compile error
jianghan <jianghan@xiaomi.com>
2014-03-12 19:46:48 -0700
Commit: 87e4dd5, github.com/apache/spark/pull/132
SPARK-1162 Added top in python.
Prashant Sharma <prashant.s@imaginea.com>
2014-03-12 15:57:54 -0700
Commit: 51a77e9, github.com/apache/spark/pull/93
Version fix in pom file
Patrick Wendell <pwendell@gmail.com>
2014-03-11 14:48:01 -0700
Commit: 7049164
Log4j build fix on 0.9 branch
Patrick Wendell <pwendell@gmail.com>
2014-03-11 11:53:29 -0700
Commit: 6cbd580
SPARK-1167: Remove metrics-ganglia from default build due to LGPL issues...
Patrick Wendell <pwendell@gmail.com>
2014-03-11 11:24:21 -0700
Commit: 0c91927, github.com/apache/spark/pull/108
For outputformats that are Configurable, call setConf before sending data to them.
Bryn Keller <bryn.keller@intel.com>
2014-03-09 17:47:46 -0700
Commit: 6f0db0a, github.com/apache/spark/pull/638
SPARK-1190: Do not initialize log4j if slf4j log4j backend is not being used
Patrick Wendell <pwendell@gmail.com>
2014-03-08 16:02:56 -0800
Commit: 0f0d044, github.com/apache/spark/pull/107
SPARK-1184: Update the distribution tar.gz to include spark-assembly jar
Mark Grover <mark@apache.org>
2014-03-05 16:55:36 -0800
Commit: 0fc0fdb, github.com/apache/spark/pull/78
SPARK-1109 wrong API docs for pyspark map function
Prashant Sharma <prashant.s@imaginea.com>
2014-03-04 15:33:00 -0800
Commit: 7ea89ec, github.com/apache/spark/pull/73
Add Jekyll tag to isolate "production-only" doc components. (0.9 version)
Patrick Wendell <pwendell@gmail.com>
2014-03-02 18:18:44 -0800
Commit: 267d96c, github.com/apache/spark/pull/57
Removed reference to incubation in Spark user docs.
Reynold Xin <rxin@apache.org>
2014-02-27 21:14:18 -0800
Commit: f2bf44a, github.com/apache/spark/pull/2
[SPARK-1089] fix the regression problem on ADD_JARS in 0.9
CodingCat <zhunansjtu@gmail.com>
2014-02-26 23:42:53 -0800
Commit: bc5e7d7, github.com/apache/spark/pull/13
Removed reference to incubation in README.md.
Reynold Xin <rxin@apache.org>
2014-02-26 16:53:56 -0800
Commit: 349764d, github.com/apache/spark/pull/1
SPARK-1115: Catch depickling errors
Bouke van der Bijl <boukevanderbijl@gmail.com>
2014-02-26 14:53:30 -0800
Commit: 886a466, github.com/apache/incubator-spark/pull/644
SPARK-1135: fix broken anchors in docs
Matei Zaharia <matei@databricks.com>
2014-02-26 11:56:12 -0800
Commit: 6fe72dd, github.com/apache/spark/pull/3
Fix removal from shuffleToMapStage to search for a key-value pair with our stage instead of using our shuffleID.
Matei Zaharia <matei@databricks.com>
2014-02-24 17:01:21 -0800
Commit: 0661cdc
SPARK-1124: Fix infinite retries of reduce stage when a map stage failed
Matei Zaharia <matei@databricks.com>
2014-02-24 17:00:47 -0800
Commit: 5e74b8e
[SPARK-1055] fix the SCALA_VERSION and SPARK_VERSION in docker file
CodingCat <zhunansjtu@gmail.com>, Nan Zhu <CodingCat@users.noreply.github.com>
2014-02-22 15:39:41 -0800
Commit: 00db30c, github.com/apache/incubator-spark/pull/634
SPARK-1117: update accumulator docs
Xiangrui Meng <meng@databricks.com>
2014-02-21 22:44:59 -0800
Commit: ed58742, github.com/apache/incubator-spark/pull/631
[SPARK-1113] External spilling - fix Int.MaxValue hash code collision bug
Andrew Or <andrewor14@gmail.com>
2014-02-21 20:06:09 -0800
Commit: 84131fe, github.com/apache/incubator-spark/pull/624
MLLIB-25: Implicit ALS runs out of memory for moderately large numbers of features
Sean Owen <sowen@cloudera.com>
2014-02-21 13:39:17 -0800
Commit: 998abae, github.com/apache/incubator-spark/pull/629
SPARK-1111: URL Validation Throws Error for HDFS URL's
Patrick Wendell <pwendell@gmail.com>
2014-02-21 11:12:38 -0800
Commit: b3fff96, github.com/apache/incubator-spark/pull/625
Super minor: Add require for mergeCombiners in combineByKey
Aaron Davidson <aaron@databricks.com>
2014-02-20 16:46:29 -0800
Commit: 3c44ff4, github.com/apache/incubator-spark/pull/623
[SPARK-1105] fix site scala version error in docs
CodingCat <zhunansjtu@gmail.com>
2014-02-19 15:56:24 -0800
Commit: 289d761, github.com/apache/incubator-spark/pull/618
Revert "[SPARK-1105] fix site scala version error in doc"
Patrick Wendell <pwendell@gmail.com>
2014-02-18 17:47:34 -0800
Commit: 7bde72e
[SPARK-1105] fix site scala version error in doc
CodingCat <zhunansjtu@gmail.com>
2014-02-18 16:33:41 -0800
Commit: 0f0395c, github.com/apache/incubator-spark/pull/616
Worker registration logging fix
Andrew Ash <andrew@andrewash.com>
2014-02-17 09:52:16 -0800
Commit: b0b5288, github.com/apache/incubator-spark/pull/608
fix for https://spark-project.atlassian.net/browse/SPARK-1052
Bijay Bisht <bijay.bisht@gmail.com>
2014-02-16 16:52:57 -0800
Commit: e797c1a, github.com/apache/incubator-spark/pull/568
Add c3 instance types to Spark EC2
Christian Lundgren <christian.lundgren@gameanalytics.com>
2014-02-13 12:44:21 -0800
Commit: 19b4bb2, github.com/apache/incubator-spark/pull/595
SPARK-1088: Create a script for running tests so we can have version specific testing on Jenkins (branch-0.9)
Reynold Xin <rxin@apache.org>
2014-02-12 23:42:58 -0800
Commit: e5b86b1, github.com/apache/incubator-spark/pull/593
Ported hadoopClient jar for < 1.0.1 fix
Bijay Bisht <bijay.bisht@gmail.com>
2014-02-12 23:42:10 -0800
Commit: 8093de1, github.com/apache/incubator-spark/pull/584
754bc18 2014-02-12 14:26:39 -0800
Merge pull request #590 from rxin/scalastyle.
[SPARK-1085: Fix Jenkins pull request builder for branch-0.9 (scalastyle command not found)]
28f88c5 2014-02-11 22:43:09 -0800
Merge pull request #583 from colorant/zookeeper.
[Minor fix for ZooKeeperPersistenceEngine to use configured working dir]
e70690f 2014-02-09 23:33:35 -0800
Revert "Merge pull request #560 from pwendell/logging. Closes #560."
[This reverts commit 2e3d1c31db55c7f961e559e47bb497ae15cb74d7.]
de22abc 2014-02-08 23:37:05 -0800
Merge pull request #562 from jyotiska/master. Closes #562.
[Added example Python code for sort]
2e3d1c3 2014-02-08 23:35:41 -0800
Merge pull request #560 from pwendell/logging. Closes #560.
[[WIP] SPARK-1067: Default log4j initialization causes errors for those not using log4j]
22e0a3b 2014-02-08 13:00:07 -0800
Merge pull request #561 from Qiuzhuang/master. Closes #561.
[Kill drivers in postStop() for Worker.]
ce179f6 2014-02-06 22:06:30 -0800
Merge pull request #533 from andrewor14/master. Closes #533.
[External spilling - generalize batching logic]
24e5298 2014-02-06 16:15:36 -0800
Merge pull request #450 from kayousterhout/fetch_failures. Closes #450.
[Only run ResubmitFailedStages event after a fetch fails]
94896bb 2014-02-06 16:13:10 -0800
Merge pull request #321 from kayousterhout/ui_kill_fix. Closes #321.
[Inform DAG scheduler about all started/finished tasks.]
44a2b03 2014-02-05 23:38:25 -0800
Merge pull request #545 from kayousterhout/fix_progress. Closes #545.
[Fix off-by-one error with task progress info log.]
b044b0b 2014-02-05 23:37:38 -0800
Merge pull request #526 from tgravescs/yarn_client_stop_am_fix. Closes #526.
[spark on yarn - yarn-client mode doesn't always exit immediately]
d815cfa 2014-02-04 09:47:25 -0800
Merge pull request #534 from sslavic/patch-1. Closes #534.
[Fixed wrong path to compute-classpath.cmd]
f3cba2d 2014-02-04 09:46:00 -0800
Merge pull request #535 from sslavic/patch-2. Closes #535.
[Fixed typo in scaladoc]
5f63f32 2014-02-03 22:44:30 -0800
Merge pull request #449 from CrazyJvm/master
[SPARK-1028 : fix "set MASTER automatically fails" bug.]
6e4d089 2014-02-03 22:42:43 -0800
Merge pull request #414 from soulmachine/code-style
[Code clean up for mllib]
0021ef9 2014-02-03 22:42:01 -0800
Merge pull request #445 from kayousterhout/exec_lost
[Fail rather than hanging if a task crashes the JVM.]
dc8adf1 2014-02-03 22:41:30 -0800
Merge pull request #489 from ash211/patch-6
[Clarify spark.default.parallelism]
574741f 2014-02-03 22:40:55 -0800
Merge pull request #493 from kayousterhout/double_add
[Fixed bug where task set managers are added to queue twice]
1280e8a 2014-02-03 22:40:29 -0800
Merge pull request #511 from JoshRosen/SPARK-1040
[Fix ClassCastException in JavaPairRDD.collectAsMap() (SPARK-1040)]
2c6c9b9 2014-02-03 22:39:59 -0800
Merge pull request #504 from JoshRosen/SPARK-1025
[Fix PySpark hang when input files are deleted (SPARK-1025)]
b10f607 2014-02-03 22:39:10 -0800
Merge pull request #516 from sarutak/master
[modified SparkPluginBuild.scala to use https protocol for accessing gith...]
18520f5 2014-02-03 22:37:38 -0800
Merge pull request #490 from hsaputra/modify_checkoption_with_isdefined
[Replace the check for None Option with isDefined and isEmpty in Scala code]
a414071 2014-01-31 16:54:33 -0800
Merge pull request #524 from rxin/doc
[Added spark.shuffle.file.buffer.kb to configuration doc.]
a41a83c 2014-01-31 16:53:26 -0800
Merge pull request #527 from ankurdave/graphx-assembly-pom
[Add GraphX to assembly/pom.xml]
d18fe1f 2014-01-28 21:55:15 -0800
Merge pull request #497 from tdas/docs-update
[Updated Spark Streaming Programming Guide]
5edbd17 2014-01-28 21:32:58 -0800
Merge pull request #523 from JoshRosen/SPARK-1043
[Switch from MUTF8 to UTF8 in PySpark serializers.]
[maven-release-plugin] prepare for next development iteration
Ubuntu <ubuntu@ip-10-109-132-81.ec2.internal>
2014-01-24 06:15:15 +0000
Commit: 0f60ef2
Release 0.9.0-incubating
d0a105d Thu Jan 23 20:53:31 2014 -0800
Merge pull request #505 from JoshRosen/SPARK-1026
[Deprecate mapPartitionsWithSplit in PySpark (SPARK-1026)]
e66d4c2 Thu Jan 23 19:47:16 2014 -0800
Merge pull request #503 from pwendell/master
[Fix bug on read-side of external sort when using Snappy.]
e8d3f2b Thu Jan 23 19:20:22 2014 -0800
Merge pull request #502 from pwendell/clone-1
[Remove Hadoop object cloning and warn users making Hadoop RDD's.]
7a62353 Thu Jan 23 19:09:25 2014 -0800
Merge pull request #501 from JoshRosen/cartesian-rdd-fixes
[Fix two bugs in PySpark cartesian(): SPARK-978 and SPARK-1034]
51960b8 Wed Jan 22 19:37:50 2014 -0800
Merge pull request #496 from pwendell/master
[Fix bug in worker clean-up in UI]
828f7b4 Wed Jan 22 15:45:18 2014 -0800
Merge pull request #495 from srowen/GraphXCommonsMathDependency
[Fix graphx Commons Math dependency]
dc5857a Wed Jan 22 14:33:25 2014 -0800
Merge pull request #492 from skicavs/master
[fixed job name and usage information for the JavaSparkPi example]
dd533c9 Wed Jan 22 14:15:58 2014 -0800
Merge pull request #478 from sryza/sandy-spark-1033
[SPARK-1033. Ask for cores in Yarn container requests]
b6fd3cd Tue Jan 21 00:12:01 2014 -0800
Merge pull request #480 from pwendell/0.9-fixes
[Handful of 0.9 fixes]
e5f8917 Mon Jan 20 23:35:07 2014 -0800
Merge pull request #484 from tdas/run-example-fix
[Made run-example respect SPARK_JAVA_OPTS and SPARK_MEM.]
410ba06 Mon Jan 20 22:26:14 2014 -0800
Merge pull request #482 from tdas/streaming-example-fix
[Added StreamingContext.awaitTermination to streaming examples]
f137947 Mon Jan 20 22:24:07 2014 -0800
Merge pull request #483 from pwendell/gitignore
[Restricting /lib to top level directory in .gitignore]
94ae25d Sun Jan 19 11:33:51 2014 -0800
Merge pull request #470 from tgravescs/fix_spark_examples_yarn
[Only log error on missing jar to allow spark examples to jar.]
0f077b5 Sun Jan 19 10:30:29 2014 -0800
Merge pull request #458 from tdas/docs-update
[Updated java API docs for streaming, along with very minor changes in the code examples.]
03019d1 Sat Jan 18 16:29:43 2014 -0800
Merge pull request #459 from srowen/UpdaterL2Regularization
[Correct L2 regularized weight update with canonical form]
76147a2 Sat Jan 18 16:24:16 2014 -0800
Merge pull request #437 from mridulm/master
[Minor api usability changes]
4ac8cab Sat Jan 18 16:22:46 2014 -0800
Merge pull request #426 from mateiz/py-ml-tests
[Re-enable Python MLlib tests (require Python 2.7 and NumPy 1.7+)]
34e911c Sat Jan 18 16:17:34 2014 -0800
Merge pull request #462 from mateiz/conf-file-fix
[Remove Typesafe Config usage and conf files to fix nested property names]
ff7201c Sat Jan 18 12:50:02 2014 -0800
Merge pull request #461 from pwendell/master
[Use renamed shuffle spill config in CoGroupedRDD.scala]
7b0d5a5 Thu Jan 16 23:18:48 2014 -0800
Merge pull request #451 from Qiuzhuang/master
[Fixed Window spark shell launch script error.]
4ccedb3 Wed Jan 15 14:26:48 2014 -0800
Merge pull request #444 from mateiz/py-version
[Clarify that Python 2.7 is only needed for MLlib]
e3fa36f Wed Jan 15 13:56:04 2014 -0800
Merge pull request #442 from pwendell/standalone
[Workers should use working directory as spark home if it's not specified]
29c76d9 Wed Jan 15 13:55:48 2014 -0800
Merge pull request #443 from tdas/filestream-fix
[Made some classes private[stremaing] and deprecated a method in JavaStreamingContext.]
aca40aa Wed Jan 15 11:15:47 2014 -0800
Merge pull request #441 from pwendell/graphx-build
[GraphX shouldn't list Spark as provided.]
e12c374 Wed Jan 15 10:01:43 2014 -0800
Merge pull request #433 from markhamstra/debFix
[Updated Debian packaging]
2f015c2 Tue Jan 14 23:17:28 2014 -0800
Merge pull request #436 from ankurdave/VertexId-case
[Rename VertexID -> VertexId in GraphX]
2859cab Tue Jan 14 23:08:19 2014 -0800
Merge pull request #435 from tdas/filestream-fix
[Fixed the flaky tests by making SparkConf not serializable]
fbfbb33 Tue Jan 14 23:06:29 2014 -0800
Merge pull request #434 from rxin/graphxmaven
[Fixed SVDPlusPlusSuite in Maven build.]
2c6c07f Tue Jan 14 21:53:05 2014 -0800
Merge pull request #424 from jegonzal/GraphXProgrammingGuide
[Additional edits for clarity in the graphx programming guide.]
6fa4e02 Tue Jan 14 21:51:25 2014 -0800
Merge pull request #431 from ankurdave/graphx-caching-doc
[Describe caching and uncaching in GraphX programming guide]
2f930d5 Tue Jan 14 15:00:11 2014 -0800
Merge pull request #428 from pwendell/writeable-objects
[Don't clone records for text files]
329c9df Tue Jan 14 14:53:36 2014 -0800
Merge pull request #429 from ankurdave/graphx-examples-pom.xml
[Add GraphX dependency to examples/pom.xml]
a14933d Tue Jan 14 14:52:42 2014 -0800
Merge pull request #427 from pwendell/deprecate-aggregator
[Deprecate rather than remove old combineValuesByKey function]
119b6c5 Tue Jan 14 13:29:08 2014 -0800
Merge pull request #425 from rxin/scaladoc
[API doc update & make Broadcast public]
bf3b150 Tue Jan 14 09:45:22 2014 -0800
Merge pull request #423 from jegonzal/GraphXProgrammingGuide
[Improving the graphx-programming-guide]
1b4adc2 Tue Jan 14 01:19:24 2014 -0800
Merge pull request #420 from pwendell/header-files
[Add missing header files]
b60840e Tue Jan 14 00:48:34 2014 -0800
Merge pull request #418 from pwendell/0.9-versions
[Version changes for release 0.9.0.]
980250b Tue Jan 14 00:05:37 2014 -0800
Merge pull request #416 from tdas/filestream-fix
[Removed unnecessary DStream operations and updated docs]
055be5c Mon Jan 13 23:26:44 2014 -0800
Merge pull request #415 from pwendell/shuffle-compress
[Enable compression by default for spills]
fdaabdc Mon Jan 13 23:08:26 2014 -0800
Merge pull request #380 from mateiz/py-bayes
[Add Naive Bayes to Python MLlib, and some API fixes]
4a805af Mon Jan 13 22:58:38 2014 -0800
Merge pull request #367 from ankurdave/graphx
[GraphX: Unifying Graphs and Tables]
945fe7a Mon Jan 13 22:56:12 2014 -0800
Merge pull request #408 from pwendell/external-serializers
[Improvements to external sorting]
68641bc Mon Jan 13 22:54:13 2014 -0800
Merge pull request #413 from rxin/scaladoc
[Adjusted visibility of various components and documentation for 0.9.0 release.]
0ca0d4d Mon Jan 13 22:32:21 2014 -0800
Merge pull request #401 from andrewor14/master
[External sorting - Add number of bytes spilled to Web UI]
08b9fec Mon Jan 13 22:29:03 2014 -0800
Merge pull request #409 from tdas/unpersist
[Automatically unpersisting RDDs that have been cleaned up from DStreams]
b07bc02 Mon Jan 13 20:45:22 2014 -0800
Merge pull request #412 from harveyfeng/master
[Add default value for HadoopRDD's `cloneRecords` constructor arg]
a2fee38 Mon Jan 13 19:45:26 2014 -0800
Merge pull request #411 from tdas/filestream-fix
[Improved logic of finding new files in FileInputDStream]
01c0d72 Mon Jan 13 16:24:30 2014 -0800
Merge pull request #410 from rxin/scaladoc1
[Updated JavaStreamingContext to make scaladoc compile.]
8038da2 Mon Jan 13 14:59:30 2014 -0800
Merge pull request #2 from jegonzal/GraphXCCIssue
[Improving documentation and identifying potential bug in CC calculation.]
b93f9d4 Mon Jan 13 12:18:05 2014 -0800
Merge pull request #400 from tdas/dstream-move
[Moved DStream and PairDSream to org.apache.spark.streaming.dstream]
e6ed13f Sun Jan 12 22:35:14 2014 -0800
Merge pull request #397 from pwendell/host-port
[Remove now un-needed hostPort option]
0b96d85 Sun Jan 12 21:31:43 2014 -0800
Merge pull request #399 from pwendell/consolidate-off
[Disable shuffle file consolidation by default]
0ab505a Sun Jan 12 21:31:04 2014 -0800
Merge pull request #395 from hsaputra/remove_simpleredundantreturn_scala
[Remove simple redundant return statements for Scala methods/functions]
405bfe8 Sun Jan 12 20:04:21 2014 -0800
Merge pull request #394 from tdas/error-handling
[Better error handling in Spark Streaming and more API cleanup]
28a6b0c Sun Jan 12 19:49:36 2014 -0800
Merge pull request #398 from pwendell/streaming-api
[Rename DStream.foreach to DStream.foreachRDD]
074f502 Sun Jan 12 17:01:13 2014 -0800
Merge pull request #396 from pwendell/executor-env
[Setting load defaults to true in executor]
82e2b92 Sun Jan 12 16:55:11 2014 -0800
Merge pull request #392 from rxin/listenerbus
[Stop SparkListenerBus daemon thread when DAGScheduler is stopped.]
288a878 Sat Jan 11 21:53:19 2014 -0800
Merge pull request #389 from rxin/clone-writables
[Minor update for clone writables and more documentation.]
dbc11df Sat Jan 11 18:07:13 2014 -0800
Merge pull request #388 from pwendell/master
[Fix UI bug introduced in #244.]
409866b Sat Jan 11 17:12:06 2014 -0800
Merge pull request #393 from pwendell/revert-381
[Revert PR 381]
6510f04 Sat Jan 11 12:48:26 2014 -0800
Merge pull request #387 from jerryshao/conf-fix
[Fix configure didn't work small problem in ALS]
ee6e7f9 Sat Jan 11 12:07:55 2014 -0800
Merge pull request #359 from ScrapCodes/clone-writables
[We clone hadoop key and values by default and reuse objects if asked to.]
4216178 Sat Jan 11 09:46:48 2014 -0800
Merge pull request #373 from jerryshao/kafka-upgrade
[Upgrade Kafka dependecy to 0.8.0 release version]
92ad18b Fri Jan 10 23:25:15 2014 -0800
Merge pull request #376 from prabeesh/master
[Change clientId to random clientId]
0b5ce7a Fri Jan 10 23:23:21 2014 -0800
Merge pull request #386 from pwendell/typo-fix
[Small typo fix]
1d7bef0 Fri Jan 10 18:53:03 2014 -0800
Merge pull request #381 from mateiz/default-ttl
[Fix default TTL for metadata cleaner]
44d6a8e Fri Jan 10 17:51:50 2014 -0800
Merge pull request #382 from RongGu/master
[Fix a type error in comment lines]
88faa30 Fri Jan 10 17:14:22 2014 -0800
Merge pull request #385 from shivaram/add-i2-instances
[Add i2 instance types to Spark EC2.]
f265531 Fri Jan 10 16:25:44 2014 -0800
Merge pull request #383 from tdas/driver-test
[API for automatic driver recovery for streaming programs and other bug fixes]
d37408f Fri Jan 10 16:25:01 2014 -0800
Merge pull request #377 from andrewor14/master
[External Sorting for Aggregator and CoGroupedRDDs (Revisited)]
0eaf01c Fri Jan 10 15:32:19 2014 -0800
Merge pull request #369 from pillis/master
[SPARK-961 Add a Vector.random() method]
7cef843 Fri Jan 10 15:34:15 2014 -0600
Merge pull request #371 from tgravescs/yarn_client_addjar_misc_fixes
[Yarn client addjar and misc fixes]
7b58f11 Fri Jan 10 12:47:46 2014 -0800
Merge pull request #384 from pwendell/debug-logs
[Make DEBUG-level logs consummable.]
23d2995 Fri Jan 10 10:20:02 2014 -0800
Merge pull request #1 from jegonzal/graphx
[ProgrammingGuide]
0ebc973 Thu Jan 9 23:58:49 2014 -0800
Merge pull request #375 from mateiz/option-fix
[Fix bug added when we changed AppDescription.maxCores to an Option]
dd03cea Thu Jan 9 23:38:03 2014 -0800
Merge pull request #378 from pwendell/consolidate_on
[Enable shuffle consolidation by default.]
997c830 Thu Jan 9 22:22:20 2014 -0800
Merge pull request #363 from pwendell/streaming-logs
[Set default logging to WARN for Spark streaming examples.]
300eaa9 Thu Jan 9 20:29:51 2014 -0800
Merge pull request #353 from pwendell/ipython-simplify
[Simplify and fix pyspark script.]
4b074fa Thu Jan 9 19:03:55 2014 -0800
Merge pull request #374 from mateiz/completeness
[Add some missing Java API methods]
a9d5333 Thu Jan 9 18:46:46 2014 -0800
Merge pull request #294 from RongGu/master
[Bug fixes for updating the RDD block's memory and disk usage information]
d86a85e Thu Jan 9 18:37:52 2014 -0800
Merge pull request #293 from pwendell/standalone-driver
[SPARK-998: Support Launching Driver Inside of Standalone Mode]
26cdb5f Thu Jan 9 17:16:34 2014 -0800
Merge pull request #372 from pwendell/log4j-fix-1
[Send logs to stderr by default (instead of stdout).]
12f414e Thu Jan 9 15:31:30 2014 -0800
Merge pull request #362 from mateiz/conf-getters
[Use typed getters for configuration settings]
365cac9 Thu Jan 9 00:56:16 2014 -0800
Merge pull request #361 from rxin/clean
[Minor style cleanup. Mostly on indenting & line width changes.]
73c724e Thu Jan 9 00:32:19 2014 -0800
Merge pull request #368 from pwendell/sbt-fix
[Don't delegate to users `sbt`.]
dceedb4 Wed Jan 8 23:19:28 2014 -0800
Merge pull request #364 from pwendell/fix
[Fixing config option "retained_stages" => "retainedStages".]
04d83fc Wed Jan 8 11:55:37 2014 -0800
Merge pull request #360 from witgo/master
[fix make-distribution.sh show version: command not found]
56ebfea Wed Jan 8 11:50:06 2014 -0800
Merge pull request #357 from hsaputra/set_boolean_paramname
[Set boolean param name for call to SparkHadoopMapReduceUtil.newTaskAttemptID]
bdeaeaf Wed Jan 8 11:48:39 2014 -0800
Merge pull request #358 from pwendell/add-cdh
[Add CDH Repository to Maven Build]
5cae05f Wed Jan 8 11:47:28 2014 -0800
Merge pull request #356 from hsaputra/remove_deprecated_cleanup_method
[Remove calls to deprecated mapred's OutputCommitter.cleanupJob]
6eef78d Wed Jan 8 08:49:20 2014 -0600
Merge pull request #345 from colorant/yarn
[support distributing extra files to worker for yarn client mode]
bb6a39a Tue Jan 7 22:32:18 2014 -0800
Merge pull request #322 from falaki/MLLibDocumentationImprovement
[SPARK-1009 Updated MLlib docs to show how to use it in Python]
cb1b927 Tue Jan 7 22:26:28 2014 -0800
Merge pull request #355 from ScrapCodes/patch-1
[Update README.md]
c0f0155 Tue Jan 7 22:21:52 2014 -0800
Merge pull request #313 from tdas/project-refactor
[Refactored the streaming project to separate external libraries like Twitter, Kafka, Flume, etc.]
f5f12dc Tue Jan 7 21:56:35 2014 -0800
Merge pull request #336 from liancheng/akka-remote-lookup
[Get rid of `Either[ActorRef, ActorSelection]']
11891e6 Wed Jan 8 00:32:18 2014 -0500
Merge pull request #327 from lucarosellini/master
[Added ‘-i’ command line option to Spark REPL]
7d0aac9 Wed Jan 8 00:30:45 2014 -0500
Merge pull request #354 from hsaputra/addasfheadertosbt
[Add ASF header to the new sbt script.]
d75dc42 Wed Jan 8 00:30:03 2014 -0500
Merge pull request #350 from mateiz/standalone-limit
[Add way to limit default # of cores used by apps in standalone mode]
61674bc Tue Jan 7 18:32:13 2014 -0800
Merge pull request #352 from markhamstra/oldArch
[Don't leave os.arch unset after BlockManagerSuite]
b2e690f Tue Jan 7 16:57:08 2014 -0800
Merge pull request #328 from falaki/MatrixFactorizationModel-fix
[SPARK-1012: DAGScheduler Exception Fix]
6ccf8ce Tue Jan 7 15:49:14 2014 -0800
Merge pull request #351 from pwendell/maven-fix
[Add log4j exclusion rule to maven.]
7d5fa17 Tue Jan 7 11:31:34 2014 -0800
Merge pull request #337 from yinxusen/mllib-16-bugfix
[Mllib 16 bugfix]
71fc113 Tue Jan 7 11:30:35 2014 -0800
Merge pull request #349 from CodingCat/support-worker_dir
[add the comments about SPARK_WORKER_DIR]
15d9534 Tue Jan 7 08:10:02 2014 -0800
Merge pull request #318 from srowen/master
[Suggested small changes to Java code for slightly more standard style, encapsulation and in some cases performance]
468af0f Tue Jan 7 08:09:01 2014 -0800
Merge pull request #348 from prabeesh/master
[spark -> org.apache.spark]
c3cf047 Tue Jan 7 00:54:25 2014 -0800
Merge pull request #339 from ScrapCodes/conf-improvements
[Conf improvements]
a862caf Tue Jan 7 00:18:20 2014 -0800
Merge pull request #331 from holdenk/master
[Add a script to download sbt if not present on the system]
b97ef21 Mon Jan 6 20:12:57 2014 -0800
Merge pull request #346 from sproblvem/patch-1
[Update stop-slaves.sh]
7210257 Mon Jan 6 18:25:44 2014 -0800
Merge pull request #128 from adamnovak/master
[Fix failing "sbt/sbt publish-local" by adding a no-argument PrimitiveKeyOpenHashMap constructor ]
e4d6057 Mon Jan 6 14:56:54 2014 -0800
Merge pull request #343 from pwendell/build-fix
[Fix test breaking downstream builds]
93bf962 Mon Jan 6 11:42:41 2014 -0800
Merge pull request #340 from ScrapCodes/sbt-fixes
[Made java options to be applied during tests so that they become self explanatory.]
60edeb3 Mon Jan 6 11:40:32 2014 -0800
Merge pull request #338 from ScrapCodes/ning-upgrade
[SPARK-1005 Ning upgrade]
c708e81 Mon Jan 6 11:35:48 2014 -0800
Merge pull request #341 from ash211/patch-5
[Clarify spark.cores.max in docs]
33fcb91 Mon Jan 6 11:19:23 2014 -0800
Merge pull request #342 from tgravescs/fix_maven_protobuf
[Change protobuf version for yarn alpha back to 2.4.1]
357083c Mon Jan 6 10:29:04 2014 -0800
Merge pull request #330 from tgravescs/fix_addjars_null_handling
[Fix handling of empty SPARK_EXAMPLES_JAR]
a2e7e04 Sun Jan 5 22:37:36 2014 -0800
Merge pull request #333 from pwendell/logging-silence
[Quiet ERROR-level Akka Logs]
5b0986a Sun Jan 5 19:25:09 2014 -0800
Merge pull request #334 from pwendell/examples-fix
[Removing SPARK_EXAMPLES_JAR in the code]
f4b924f Sun Jan 5 17:11:47 2014 -0800
Merge pull request #335 from rxin/ser
[Fall back to zero-arg constructor for Serializer initialization if there is no constructor that accepts SparkConf.]
d43ad3e Sat Jan 4 16:29:30 2014 -0800
Merge pull request #292 from soulmachine/naive-bayes
[standard Naive Bayes classifier]
86404da Sat Jan 4 14:55:54 2014 -0800
Merge pull request #127 from jegonzal/MapByPartition
[Adding mapEdges and mapTriplets by Partition]
e68cdb1 Sat Jan 4 13:46:02 2014 -0800
Merge pull request #124 from jianpingjwang/master
[refactor and bug fix]
280ddf6 Sat Jan 4 12:54:41 2014 -0800
Merge pull request #121 from ankurdave/more-simplify
[Simplify GraphImpl internals further]
10fe23b Fri Jan 3 23:50:14 2014 -0800
Merge pull request #329 from pwendell/remove-binaries
[SPARK-1002: Remove Binaries from Spark Source]
c4d6145 Fri Jan 3 16:30:53 2014 -0800
Merge pull request #325 from witgo/master
[Modify spark on yarn to create SparkConf process]
4ae101f Fri Jan 3 11:24:35 2014 -0800
Merge pull request #317 from ScrapCodes/spark-915-segregate-scripts
[Spark-915 segregate scripts]
87248bd Fri Jan 3 00:45:31 2014 -0800
Merge pull request #1 from apache/master
[Merge latest Spark changes]
30b9db0 Thu Jan 2 23:15:55 2014 -0800
Merge pull request #285 from colorant/yarn-refactor
[Yarn refactor]
498a5f0 Thu Jan 2 19:06:40 2014 -0800
Merge pull request #323 from tgravescs/sparkconf_yarn_fix
[fix spark on yarn after the sparkConf changes]
0475ca8 Thu Jan 2 15:17:08 2014 -0800
Merge pull request #320 from kayousterhout/erroneous_failed_msg
[Remove erroneous FAILED state for killed tasks.]
588a169 Thu Jan 2 13:20:54 2014 -0800
Merge pull request #297 from tdas/window-improvement
[Improvements to DStream window ops and refactoring of Spark's CheckpointSuite]
5e67cdc Thu Jan 2 12:56:28 2014 -0800
Merge pull request #319 from kayousterhout/remove_error_method
[Removed redundant TaskSetManager.error() function.]
ca67909 Thu Jan 2 15:54:54 2014 -0500
Merge pull request #311 from tmyklebu/master
[SPARK-991: Report information gleaned from a Python stacktrace in the UI]
3713f81 Wed Jan 1 21:29:12 2014 -0800
Merge pull request #309 from mateiz/conf2
[SPARK-544. Migrate configuration to a SparkConf class]
c1d928a Wed Jan 1 17:03:48 2014 -0800
Merge pull request #312 from pwendell/log4j-fix-2
[SPARK-1008: Logging improvments]
dc9cb83 Wed Jan 1 13:28:34 2014 -0800
Merge pull request #126 from jegonzal/FixingPersist
[Fixing Persist Behavior]
9a0ff72 Tue Dec 31 21:50:24 2013 -0800
Merge pull request #314 from witgo/master
[restore core/pom.xml file modification]
8b8e70e Tue Dec 31 17:48:24 2013 -0800
Merge pull request #73 from falaki/ApproximateDistinctCount
[Approximate distinct count]
63b411d Tue Dec 31 14:31:28 2013 -0800
Merge pull request #238 from ngbinh/upgradeNetty
[upgrade Netty from 4.0.0.Beta2 to 4.0.13.Final]
32d6ae9 Tue Dec 31 13:51:07 2013 -0800
Merge pull request #120 from ankurdave/subgraph-reuses-view
[Reuse VTableReplicated in GraphImpl.subgraph]
55b7e2f Tue Dec 31 10:12:51 2013 -0800
Merge pull request #289 from tdas/filestream-fix
[Bug fixes for file input stream and checkpointing]
2b71ab9 Mon Dec 30 11:01:30 2013 -0800
Merge pull request from aarondav: Utilize DiskBlockManager pathway for temp file writing
[This gives us a couple advantages:]
50e3b8e Mon Dec 30 07:44:26 2013 -0800
Merge pull request #308 from kayousterhout/stage_naming
[Changed naming of StageCompleted event to be consistent]
72a17b6 Sat Dec 28 21:25:40 2013 -1000
Revert "Merge pull request #310 from jyunfan/master"
[This reverts commit 79b20e4dbe3dcd8559ec8316784d3334bb55868b, reversing]
79b20e4 Sat Dec 28 21:13:36 2013 -1000
Merge pull request #310 from jyunfan/master
[Fix typo in the Accumulators section]
7375047 Sat Dec 28 13:25:06 2013 -0800
Merge pull request #304 from kayousterhout/remove_unused
[Removed unused failed and causeOfFailure variables (in TaskSetManager)]
ad3dfd1 Fri Dec 27 22:10:14 2013 -0500
Merge pull request #307 from kayousterhout/other_failure
[Removed unused OtherFailure TaskEndReason.]
b579b83 Fri Dec 27 22:09:04 2013 -0500
Merge pull request #306 from kayousterhout/remove_pending
[Remove unused hasPendingTasks methods]
19672dc Fri Dec 27 13:37:10 2013 -0800
Merge pull request #305 from kayousterhout/line_spacing
[Fixed >100char lines in DAGScheduler.scala]
7be1e57 Thu Dec 26 23:41:40 2013 -1000
Merge pull request #298 from aarondav/minor
[Minor: Decrease margin of left side of Log page]
7d811ba Thu Dec 26 23:39:58 2013 -1000
Merge pull request #302 from pwendell/SPARK-1007
[SPARK-1007: spark-class2.cmd should change SCALA_VERSION to be 2.10]
5e69fc5 Thu Dec 26 19:10:39 2013 -0500
Merge pull request #295 from markhamstra/JobProgressListenerNPE
[Avoid a lump of coal (NPE) in JobProgressListener's stocking.]
da20270 Thu Dec 26 12:11:52 2013 -0800
Merge pull request #1 from aarondav/driver
[Refactor DriverClient to be more Actor-based]
e240bad Thu Dec 26 12:30:48 2013 -0500
Merge pull request #296 from witgo/master
[Renamed ClusterScheduler to TaskSchedulerImpl for yarn and new-yarn package]
c344ed0 Thu Dec 26 01:31:06 2013 -0500
Merge pull request #283 from tmyklebu/master
[Python bindings for mllib]
56094bc Wed Dec 25 13:14:33 2013 -0500
Merge pull request #290 from ash211/patch-3
[Typo: avaiable -> available]
4842a07 Wed Dec 25 01:52:15 2013 -0800
Merge pull request #287 from azuryyu/master
[Fixed job name in the java streaming example.]
85a344b Tue Dec 24 16:35:06 2013 -0800
Merge pull request #127 from kayousterhout/consolidate_schedulers
[Deduplicate Local and Cluster schedulers.]
c2dd6bc Tue Dec 24 14:36:47 2013 -0800
Merge pull request #279 from aarondav/shuffle-cleanup0
[Clean up shuffle files once their metadata is gone]
3bf7c70 Tue Dec 24 16:37:13 2013 -0500
Merge pull request #275 from ueshin/wip/changeclasspathorder
[Change the order of CLASSPATH.]
d63856c Mon Dec 23 22:07:26 2013 -0800
Merge pull request #286 from rxin/build
[Show full stack trace and time taken in unit tests.]
23a9ae6 Tue Dec 24 00:08:48 2013 -0500
Merge pull request #277 from tdas/scheduler-update
[Refactored the streaming scheduler and added StreamingListener interface]
11107c9 Mon Dec 23 10:38:20 2013 -0800
Merge pull request #244 from leftnoteasy/master
[Added SPARK-968 implementation for review]
44e4205 Sun Dec 22 11:44:18 2013 -0800
Merge pull request #116 from jianpingjwang/master
[remove unused variables and fix a bug]
4797c22 Fri Dec 20 13:30:39 2013 -0800
Merge pull request #118 from ankurdave/VertexPartitionSuite
[Test VertexPartition and fix bugs]
0bc57c5 Fri Dec 20 11:56:54 2013 -0800
Merge pull request #280 from aarondav/minor
[Minor cleanup for standalone scheduler]
ac70b8f Fri Dec 20 10:56:10 2013 -0800
Merge pull request #117 from ankurdave/more-tests
[More tests]
45310d4 Thu Dec 19 22:08:20 2013 -0800
Merge pull request #115 from ankurdave/test-reorg
[Reorganize unit tests; improve GraphSuite test coverage]
9228ec8 Thu Dec 19 21:37:15 2013 -0800
Merge pull request #1 from aarondav/127
[Merge master into 127]
eca68d4 Thu Dec 19 18:12:22 2013 -0800
Merge pull request #272 from tmyklebu/master
[Track and report task result serialisation time.]
7990c56 Thu Dec 19 13:35:09 2013 -0800
Merge pull request #276 from shivaram/collectPartition
[Add collectPartition to JavaRDD interface.]
440e531 Thu Dec 19 10:38:56 2013 -0800
Merge pull request #278 from MLnick/java-python-tostring
[Add toString to Java RDD, and __repr__ to Python RDD]
d8d3f3e Thu Dec 19 00:06:43 2013 -0800
Merge pull request #183 from aarondav/spark-959
[[SPARK-959] Explicitly depend on org.eclipse.jetty.orbit jar]
bfba532 Wed Dec 18 22:22:21 2013 -0800
Merge pull request #247 from aarondav/minor
[Increase spark.akka.askTimeout default to 30 seconds]
da301b5 Wed Dec 18 20:03:29 2013 -0800
Merge pull request #112 from amatsukawa/scc
[Strongly connected component algorithm]
c64a53a Wed Dec 18 16:56:26 2013 -0800
Merge pull request #267 from JoshRosen/cygwin
[Fix Cygwin support in several scripts.]
a645ef6 Wed Dec 18 16:07:52 2013 -0800
Merge pull request #48 from amatsukawa/add_project_to_graph
[Add mask operation on graph and filter graph primitive]
d7ebff0 Wed Dec 18 15:38:48 2013 -0800
Merge pull request #1 from ankurdave/add_project_to_graph
[Merge current master and reimplement Graph.mask using innerJoin]
5ea1872 Wed Dec 18 15:27:24 2013 -0800
Merge pull request #274 from azuryy/master
[Fixed the example link in the Scala programing guid.]
3fd2e09 Wed Dec 18 12:52:36 2013 -0800
Merge pull request #104 from jianpingjwang/master
[SVD++ demo]
f4effb3 Tue Dec 17 22:26:21 2013 -0800
Merge pull request #273 from rxin/top
[Fixed a performance problem in RDD.top and BoundedPriorityQueue]
1b5eacb Tue Dec 17 13:49:17 2013 -0800
Merge pull request #102 from ankurdave/clustered-edge-index
[Add clustered index on edges by source vertex]
7a8169b Mon Dec 16 22:42:21 2013 -0800
Merge pull request #268 from pwendell/shaded-protobuf
[Add support for 2.2. to master (via shaded jars)]
0476c84 Mon Dec 16 17:19:25 2013 -0800
Merge pull request #100 from ankurdave/mrTriplets-active-set
[Support activeSet option in mapReduceTriplets]
964a3b6 Mon Dec 16 15:23:51 2013 -0800
Merge pull request #270 from ewencp/really-force-ssh-pseudo-tty-master
[Force pseudo-tty allocation in spark-ec2 script.]
5192ef3 Mon Dec 16 15:08:08 2013 -0800
Merge pull request #94 from ankurdave/load-edges-columnar
[Load edges in columnar format]
883e034 Mon Dec 16 14:16:02 2013 -0800
Merge pull request #245 from gregakespret/task-maxfailures-fix
[Fix for spark.task.maxFailures not enforced correctly.]
a51f340 Sun Dec 15 22:02:30 2013 -0800
Merge pull request #265 from markhamstra/scala.binary.version
[DRY out the POMs with scala.binary.version]
ded10ce Sun Dec 15 17:25:33 2013 -0800
Merge pull request #103 from amplab/optimizations
[Optimizations cherry-picked from SIGMOD branches]
d2ced6d Sun Dec 15 14:11:34 2013 -0800
Merge pull request #256 from MLnick/master
[Fix 'IPYTHON=1 ./pyspark' throwing ValueError]
c55e698 Sun Dec 15 12:49:02 2013 -0800
Merge pull request #257 from tgravescs/sparkYarnFixName
[Fix the --name option for Spark on Yarn]
ab85f88 Sun Dec 15 12:48:32 2013 -0800
Merge pull request #264 from shivaram/spark-class-fix
[Use CoarseGrainedExecutorBackend in spark-class]
8a56c1f Sat Dec 14 16:29:24 2013 -0800
Merge pull request #84 from amatsukawa/graphlab_enhancements
[GraphLab bug fix & set start vertex]
7db9165 Sat Dec 14 14:16:34 2013 -0800
Merge pull request #251 from pwendell/master
[Fix list rendering in YARN markdown docs.]
2fd781d Sat Dec 14 12:59:37 2013 -0800
Merge pull request #249 from ngbinh/partitionInJavaSortByKey
[Expose numPartitions parameter in JavaPairRDD.sortByKey()]
9bf192b Sat Dec 14 12:52:18 2013 -0800
Merge pull request #91 from amplab/standalone-pagerank
[Standalone PageRank]
840af5e Sat Dec 14 12:51:51 2013 -0800
Merge pull request #99 from ankurdave/only-dynamic-pregel
[Remove static Pregel; take maxIterations in dynamic Pregel]
97ac060 Sat Dec 14 00:22:45 2013 -0800
Merge pull request #259 from pwendell/scala-2.10
[Migration to Scala 2.10]
7ac944f Fri Dec 13 23:22:08 2013 -0800
Merge pull request #262 from pwendell/mvn-fix
[Fix maven build issues in 2.10 branch]
6defb06 Fri Dec 13 21:18:57 2013 -0800
Merge pull request #261 from ScrapCodes/scala-2.10
[Added a comment about ActorRef and ActorSelection difference.]
76566b1 Fri Dec 13 10:11:02 2013 -0800
Merge pull request #260 from ScrapCodes/scala-2.10
[Review comments on the PR for scala 2.10 migration.]
0aeb182 Thu Dec 12 21:14:42 2013 -0800
Merge pull request #255 from ScrapCodes/scala-2.10
[Disabled yarn 2.2 in sbt and mvn build and added a message in the sbt build.]
2e89398 Wed Dec 11 23:10:53 2013 -0800
Merge pull request #254 from ScrapCodes/scala-2.10
[Scala 2.10 migration]
ce6ca4e Wed Dec 11 22:30:54 2013 -0800
Merge pull request #97 from dcrankshaw/fix-rddtop
[Added BoundedPriorityQueue kryo registrator. Fixes top issue.]
d2efe13 Tue Dec 10 13:01:26 2013 -0800
Merge pull request #250 from pwendell/master
[README incorrectly suggests build sources spark-env.sh]
6169fe1 Mon Dec 9 16:51:36 2013 -0800
Merge pull request #246 from pwendell/master
[Add missing license headers]
d992ec6 Sun Dec 8 20:49:20 2013 -0800
Merge pull request #195 from dhardy92/fix_DebScriptPackage
[[Deb] fix package of Spark classes adding org.apache prefix in scripts embeded in .deb]
1f4a4bc Sat Dec 7 22:34:34 2013 -0800
Merge pull request #242 from pwendell/master
[Update broken links and add HDP 2.0 version string]
6494d62 Sat Dec 7 11:56:16 2013 -0800
Merge pull request #240 from pwendell/master
[SPARK-917 Improve API links in nav bar]
f466f79 Sat Dec 7 11:51:52 2013 -0800
Merge pull request #239 from aarondav/nit
[Correct spellling error in configuration.md]
3abfbfb Sat Dec 7 11:24:19 2013 -0800
Merge pull request #92 from ankurdave/rdd-names
[Set RDD names for easy debugging]
31e8a14 Fri Dec 6 21:49:55 2013 -0800
Merge pull request #90 from amplab/pregel-replicate-changed
[Replicate only changed vertices]
10c3c0c Fri Dec 6 20:29:45 2013 -0800
Merge pull request #237 from pwendell/formatting-fix
[Formatting fix]
1b38f5f Fri Dec 6 20:16:15 2013 -0800
Merge pull request #236 from pwendell/shuffle-docs
[Adding disclaimer for shuffle file consolidation]
e5d5728 Fri Dec 6 20:14:56 2013 -0800
Merge pull request #235 from pwendell/master
[Minor doc fixes and updating README]
241336a Fri Dec 6 17:29:03 2013 -0800
Merge pull request #234 from alig/master
[Updated documentation about the YARN v2.2 build process]
e039234 Fri Dec 6 11:49:59 2013 -0800
Merge pull request #190 from markhamstra/Stages4Jobs
[stageId <--> jobId mapping in DAGScheduler]
bfa6860 Fri Dec 6 11:04:03 2013 -0800
Merge pull request #233 from hsaputra/changecontexttobackend
[Change the name of input argument in ClusterScheduler#initialize from context to backend.]
3fb302c Fri Dec 6 11:03:32 2013 -0800
Merge pull request #205 from kayousterhout/logging
[Added logging of scheduler delays to UI]
87676a6 Fri Dec 6 11:01:42 2013 -0800
Merge pull request #220 from rxin/zippart
[Memoize preferred locations in ZippedPartitionsBaseRDD]
0780498 Thu Dec 5 23:29:42 2013 -0800
Merge pull request #232 from markhamstra/FiniteWait
[jobWaiter.synchronized before jobWaiter.wait]
1c8500e Thu Dec 5 16:25:44 2013 -0800
Merge pull request #88 from amplab/varenc
[Fixed a bug that variable encoding doesn't work for ints that use all 64 bits.]
e0bcaa0 Thu Dec 5 12:37:02 2013 -0800
Merge pull request #86 from ankurdave/vid-varenc
[Finish work on #85]
5d46025 Thu Dec 5 12:31:24 2013 -0800
Merge pull request #228 from pwendell/master
[Document missing configs and set shuffle consolidation to false.]
3e96b9a Thu Dec 5 12:07:36 2013 -0800
Merge pull request #85 from ankurdave/vid-varenc
[Always write Vids using variable encoding]
72b6961 Wed Dec 4 23:33:04 2013 -0800
Merge pull request #199 from harveyfeng/yarn-2.2
[Hadoop 2.2 migration]
e0347ba Wed Dec 4 17:38:06 2013 -0800
Merge pull request #83 from ankurdave/fix-tests
[Fix compile errors in GraphSuite and SerializerSuite]
182f9ba Wed Dec 4 15:52:07 2013 -0800
Merge pull request #227 from pwendell/master
[Fix small bug in web UI and minor clean-up.]
cbd3b75 Wed Dec 4 15:35:26 2013 -0800
Merge pull request #81 from amplab/clean1
[Codebase refactoring]
b9e7609 Wed Dec 4 14:42:09 2013 -0800
Merge pull request #225 from ash211/patch-3
[Add missing space after "Serialized" in StorageLevel]
055462c Wed Dec 4 14:02:11 2013 -0800
Merge pull request #226 from ash211/patch-4
[Typo: applicaton]
d6e5473 Wed Dec 4 10:28:50 2013 -0800
Merge pull request #223 from rxin/transient
[Mark partitioner, name, and generator field in RDD as @transient.]
8a3475a Tue Dec 3 14:21:40 2013 -0800
Merge pull request #218 from JoshRosen/spark-970-pyspark-unicode-error
[Fix UnicodeEncodeError in PySpark saveAsTextFile() (SPARK-970)]
46b87b8 Tue Dec 3 00:41:11 2013 -0800
Merge pull request #2 from colorant/yarn-client-2.2
[Fix pom.xml for maven build]
58d9bbc Mon Dec 2 21:58:53 2013 -0800
Merge pull request #217 from aarondav/mesos-urls
[Re-enable zk:// urls for Mesos SparkContexts]
740922f Sun Dec 1 12:46:58 2013 -0800
Merge pull request #219 from sundeepn/schedulerexception
[Scheduler quits when newStage fails]
60e23a5 Sat Nov 30 23:38:49 2013 -0800
Merge pull request #216 from liancheng/fix-spark-966
[Bugfix: SPARK-965 & SPARK-966]
34ee814 Sat Nov 30 15:10:30 2013 -0800
Merged Ankur's pull request #80 and fixed subgraph.
[]
743a31a Wed Nov 27 18:24:39 2013 -0800
Merge pull request #210 from haitaoyao/http-timeout
[add http timeout for httpbroadcast]
993e293 Wed Nov 27 00:57:54 2013 -0800
Merge pull request #1 from colorant/yarn-client-2.2
[Port yarn-client mode for new-yarn]
fb6875d Tue Nov 26 20:55:40 2013 -0800
Merge pull request #146 from JoshRosen/pyspark-custom-serializers
[Custom Serializers for PySpark]
330ada1 Tue Nov 26 19:08:33 2013 -0800
Merge pull request #207 from henrydavidge/master
[Log a warning if a task's serialized size is very big]
615213f Tue Nov 26 19:07:20 2013 -0800
Merge pull request #212 from markhamstra/SPARK-963
[[SPARK-963] Fixed races in JobLoggerSuite]
cb976df Tue Nov 26 10:23:19 2013 -0800
Merge pull request #209 from pwendell/better-docs
[Improve docs for shuffle instrumentation]
18d6df0 Tue Nov 26 00:00:07 2013 -0800
Merge pull request #86 from holdenk/master
[Add histogram functionality to DoubleRDDFunctions]
0e2109d Mon Nov 25 20:48:37 2013 -0800
Merge pull request #204 from rxin/hash
[OpenHashSet fixes]
c46067f Mon Nov 25 19:09:31 2013 -0800
Merge pull request #206 from ash211/patch-2
[Update tuning.md]
14bb465 Mon Nov 25 18:50:18 2013 -0800
Merge pull request #201 from rxin/mappartitions
[Use the proper partition index in mapPartitionsWIthIndex]
eb4296c Mon Nov 25 15:25:29 2013 -0800
Merge pull request #101 from colorant/yarn-client-scheduler
[For SPARK-527, Support spark-shell when running on YARN]
466fd06 Mon Nov 25 18:27:26 2013 +0800
Incorporated ideas from pull request #200. - Use Murmur Hash 3 finalization step to scramble the bits of HashCode instead of the simpler version in java.util.HashMap; the latter one had trouble with ranges of consecutive integers. Murmur Hash 3 is used by fastutil.
[- Don't check keys for equality when re-inserting due to growing the]
088995f Mon Nov 25 00:57:51 2013 -0800
Merge pull request #77 from amplab/upgrade
[Sync with Spark master]
62889c4 Mon Nov 25 11:27:45 2013 +0800
Merge pull request #203 from witgo/master
[ Fix Maven build for metrics-graphite]
6af03ed Sun Nov 24 16:42:37 2013 -0800
Merge pull request #76 from dcrankshaw/fix_partitioners
[Actually use partitioner command line args in Analytics.]
859d62d Sun Nov 24 16:19:51 2013 -0800
Merge pull request #151 from russellcardullo/add-graphite-sink
[Add graphite sink for metrics]
65de73c Sun Nov 24 15:52:33 2013 -0800
Merge pull request #185 from mkolod/random-number-generator
[XORShift RNG with unit tests and benchmark]
972171b Mon Nov 25 07:50:46 2013 +0800
Merge pull request #197 from aarondav/patrick-fix
[Fix 'timeWriting' stat for shuffle files]
a1a7e36 Sun Nov 24 05:15:09 2013 -0800
Merge pull request #75 from amplab/simplify
[Simplify GraphImpl internals]
718cc80 Sun Nov 24 11:02:02 2013 +0800
Merge pull request #200 from mateiz/hash-fix
[AppendOnlyMap fixes]
51aa9d6 Sat Nov 23 19:46:46 2013 +0800
Merge pull request #198 from ankurdave/zipPartitions-preservesPartitioning
[Support preservesPartitioning in RDD.zipPartitions]
18ce7e9 Fri Nov 22 17:02:40 2013 -0800
Merge pull request #73 from jegonzal/TriangleCount
[Triangle count]
086b097 Fri Nov 22 10:26:39 2013 +0800
Merge pull request #193 from aoiwelle/patch-1
[Fix Kryo Serializer buffer documentation inconsistency]
f20093c Fri Nov 22 10:12:13 2013 +0800
Merge pull request #196 from pwendell/master
[TimeTrackingOutputStream should pass on calls to close() and flush().]
4b89501 Wed Nov 20 10:36:10 2013 -0800
Merge pull request #191 from hsaputra/removesemicolonscala
[Cleanup to remove semicolons (;) from Scala code]
202f8e6 Wed Nov 20 03:26:08 2013 -0800
Merge pull request #74 from dcrankshaw/remove_sleep
[Removed sleep from pagerank in Analytics]
74ade9e Tue Nov 19 16:53:58 2013 -0800
Merge pull request #62 from dcrankshaw/partitioners
[Allow user to choose a partitioner at runtime]
f568912 Tue Nov 19 16:11:31 2013 -0800
Merge pull request #181 from BlackNiuza/fix_tasks_number
[correct number of tasks in ExecutorsUI]
aa638ed Tue Nov 19 16:05:44 2013 -0800
Merge pull request #189 from tgravescs/sparkYarnErrorHandling
[Impove Spark on Yarn Error handling]
5592580 Tue Nov 19 16:04:01 2013 -0800
Merge pull request #187 from aarondav/example-bcast-test
[Enable the Broadcast examples to work in a cluster setting]
99cfe89 Mon Nov 18 22:00:36 2013 -0500
Updates to reflect pull request code review
[]
e2ebc3a Sun Nov 17 18:42:18 2013 -0800
Merge pull request #182 from rxin/vector
[Slightly enhanced PrimitiveVector:]
26f616d Sun Nov 17 18:18:16 2013 -0800
Merge pull request #3 from aarondav/pv-test
[Add PrimitiveVectorSuite and fix bug in resize()]
1b5b358 Sat Nov 16 11:44:10 2013 -0800
Merge pull request #178 from hsaputra/simplecleanupcode
[Simple cleanup on Spark's Scala code]
62a2a71 Fri Nov 15 13:12:07 2013 -0800
Merge pull request #65 from amplab/varenc
[Use variable encoding for ints, longs, and doubles in the specialized serializers.]
f6b2e59 Thu Nov 14 23:04:55 2013 -0800
Merge pull request #1 from aarondav/scala210-master
[Various merge corrections]
96e0fb4 Thu Nov 14 22:29:28 2013 -0800
Merge pull request #173 from kayousterhout/scheduler_hang
[Fix bug where scheduler could hang after task failure.]
dfd40e9 Thu Nov 14 19:44:50 2013 -0800
Merge pull request #175 from kayousterhout/no_retry_not_serializable
[Don't retry tasks when they fail due to a NotSerializableException]
ed25105 Thu Nov 14 19:43:55 2013 -0800
Merge pull request #174 from ahirreddy/master
[Write Spark UI url to driver file on HDFS]
1a4cfbe Thu Nov 14 10:32:11 2013 -0800
Merge pull request #169 from kayousterhout/mesos_fix
[Don't ignore spark.cores.max when using Mesos Coarse mode]
5a4f483 Thu Nov 14 10:30:36 2013 -0800
Merge pull request #170 from liancheng/hadooprdd-doc-typo
[Fixed a scaladoc typo in HadoopRDD.scala]
d76f520 Thu Nov 14 10:25:48 2013 -0800
Merge pull request #171 from RIA-pierre-borckmans/master
[Fixed typos in the CDH4 distributions version codes.]
2c39d80 Wed Nov 13 23:28:01 2013 -0800
Merge pull request #69 from jegonzal/MissingVertices
[Addressing issue in Graph creation]
33b2dea Wed Nov 13 17:55:58 2013 -0800
Merge pull request #1 from ankurdave/MissingVertices
[During graph creation, create eTable earlier]
2054c61 Wed Nov 13 16:49:55 2013 -0800
Merge pull request #159 from liancheng/dagscheduler-actor-refine
[Migrate the daemon thread started by DAGScheduler to Akka actor]
9290e5b Wed Nov 13 16:48:44 2013 -0800
Merge pull request #165 from NathanHowell/kerberos-master
[spark-assembly.jar fails to authenticate with YARN ResourceManager]
a81fcb7 Wed Nov 13 10:41:01 2013 -0800
Merge pull request #68 from jegonzal/BitSetSetUntilBug
[Addressing bug in BitSet.setUntil(ind)]
39af914 Wed Nov 13 08:39:05 2013 -0800
Merge pull request #166 from ahirreddy/simr-spark-ui
[SIMR Backend Scheduler will now write Spark UI URL to HDFS, which is to ...]
f49ea28 Tue Nov 12 19:13:39 2013 -0800
Merge pull request #137 from tgravescs/sparkYarnJarsHdfsRebase
[Allow spark on yarn to be run from HDFS.]
87f2f4e Tue Nov 12 16:26:09 2013 -0800
Merge pull request #153 from ankurdave/stop-spot-cluster
[Enable stopping and starting a spot cluster]
b8bf04a Tue Nov 12 16:19:50 2013 -0800
Merge pull request #160 from xiajunluan/JIRA-923
[Fix bug JIRA-923]
dfd1ebc Tue Nov 12 09:10:05 2013 -0800
Merge pull request #164 from tdas/kafka-fix
[Made block generator thread safe to fix Kafka bug.]
2e8d450 Mon Nov 11 17:34:09 2013 -0800
Merge pull request #63 from jegonzal/VertexSetCleanup
[Cleanup of VertexSetRDD]
b8e294a Mon Nov 11 16:25:42 2013 -0800
Merge pull request #61 from ankurdave/pid2vid
[Shuffle replicated vertex attributes efficiently in columnar format]
3d7277c Mon Nov 11 15:49:28 2013 -0800
Merge pull request #55 from ankurdave/aggregateNeighbors-variants
[Specialize mapReduceTriplets for accessing subsets of vertex attributes]
23b53ef Mon Nov 11 12:30:02 2013 -0800
Merge pull request #156 from haoyuan/master
[add tachyon module]
1a06f70 Sun Nov 10 10:54:44 2013 -0800
Merge pull request #60 from amplab/rxin
[Looks good to me.]
58d4f6c Sun Nov 10 09:23:56 2013 -0800
Merge pull request #157 from rxin/kryo
[3 Kryo related changes.]
3efc019 Sat Nov 9 17:53:49 2013 -0800
Merge pull request #147 from JoshRosen/fix-java-api-completeness-checker
[Add spark-tools assembly to spark-class'ss classpath]
87954d4 Sat Nov 9 17:53:25 2013 -0800
Merge pull request #154 from soulmachine/ClusterScheduler
[Replace the thread inside ClusterScheduler.start() with an Akka scheduler]
f6c9462 Sat Nov 9 16:14:45 2013 -0800
Merge pull request #58 from jegonzal/KryoMessages
[Kryo messages]
83bf192 Sat Nov 9 15:40:29 2013 -0800
Merge pull request #155 from rxin/jobgroup
[Don't reset job group when a new job description is set.]
8af99f2 Sat Nov 9 13:48:00 2013 -0800
Merge pull request #149 from tgravescs/fixSecureHdfsAccess
[Fix secure hdfs access for spark on yarn]
72a601e Sat Nov 9 11:55:16 2013 -0800
Merge pull request #152 from rxin/repl
[Propagate SparkContext local properties from spark-repl caller thread to the repl execution thread.]
6ee05be Thu Nov 7 19:12:41 2013 -0800
Merge pull request #49 from jegonzal/graphxshell
[GraphX Console with Logo Text]
a9f96b5 Thu Nov 7 18:56:56 2013 -0800
Merge pull request #56 from jegonzal/PregelAPIChanges
[Changing Pregel API to use mapReduceTriplets instead of aggregateNeighbors]
5907137 Thu Nov 7 16:58:31 2013 -0800
Merge pull request #54 from amplab/rxin
[Converted for loops to while loops in EdgePartition.]
edf4164 Thu Nov 7 16:22:43 2013 -0800
Merge pull request #53 from amplab/rxin
[Added GraphX to classpath.]
c379e10 Thu Nov 7 16:01:47 2013 -0800
Merge pull request #51 from jegonzal/VertexSetRDD
[Reverting to Array based (materialized) output in VertexSetRDD]
3d4ad84 Thu Nov 7 11:08:27 2013 -0800
Merge pull request #148 from squito/include_appId
[Include appId in executor cmd line args]
be7e8da Wed Nov 6 23:22:47 2013 -0800
Merge pull request #23 from jerryshao/multi-user
[Add Spark multi-user support for standalone mode and Mesos]
aadeda5 Wed Nov 6 13:27:47 2013 -0800
Merge pull request #144 from liancheng/runjob-clean
[Removed unused return value in SparkContext.runJob]
951024f Wed Nov 6 09:36:14 2013 -0800
Merge pull request #145 from aarondav/sls-fix
[Attempt to fix SparkListenerSuite breakage]
bf4e613 Tue Nov 5 23:14:09 2013 -0800
Merge pull request #143 from rxin/scheduler-hang
[Ignore a task update status if the executor doesn't exist anymore.]
9f7b9bb Tue Nov 5 10:42:19 2013 -0800
Merge pull request #142 from liancheng/dagscheduler-pattern-matching
[Using case class deep match to simplify code in DAGScheduler.processEvent]
ca44b51 Tue Nov 5 01:32:55 2013 -0800
Merge pull request #50 from amplab/mergemerge
[Merge Spark master into graphx]
8106532 Mon Nov 4 20:47:14 2013 -0800
Merge pull request #139 from aarondav/shuffle-next
[Never store shuffle blocks in BlockManager]
0b26a39 Mon Nov 4 18:22:06 2013 -0800
Merge pull request #128 from shimingfei/joblogger-doc
[add javadoc to JobLogger, and some small fix]
7a26104 Mon Nov 4 17:54:06 2013 -0800
Merge pull request #130 from aarondav/shuffle
[Memory-optimized shuffle file consolidation]
b5dc339 Sun Nov 3 20:43:15 2013 -0800
Merge pull request #70 from rxin/hash1
[Fast, memory-efficient hash set, hash table implementations optimized for primitive data types.]
41ead7a Sat Nov 2 14:41:50 2013 -0700
Merge pull request #133 from Mistobaan/link_fix
[update default github]
d407c07 Sat Nov 2 14:36:37 2013 -0700
Merge pull request #134 from rxin/readme
[Fixed a typo in Hadoop version in README.]
e7c7b80 Fri Nov 1 17:58:10 2013 -0700
Merge pull request #132 from Mistobaan/doc_fix
[fix persistent-hdfs]
d6d11c2 Fri Nov 1 15:40:33 2013 -0700
Merge pull request #129 from velvia/2013-11/document-local-uris
[Document & finish support for local: URIs]
99bfcc9 Thu Oct 31 21:38:10 2013 -0700
Merge pull request #46 from jegonzal/VertexSetWithHashSet
[Switched VertexSetRDD and GraphImpl to use OpenHashSet]
fcaaf86 Thu Oct 31 18:27:30 2013 -0700
Merge pull request #44 from jegonzal/rxinBitSet
[Switching to VertexSetRDD to use @rxin BitSet and OpenHash ]
3f3c727 Thu Oct 31 09:52:25 2013 -0700
Merge pull request #41 from jegonzal/LineageTracking
[Optimizing Graph Lineage]
944f6b8 Thu Oct 31 09:40:35 2013 -0700
Merge pull request #43 from amplab/FixBitSetCastException
[Fix BitSet cast exception]
8f1098a Wed Oct 30 20:11:48 2013 -0700
Merge pull request #117 from stephenh/avoid_concurrent_modification_exception
[Handle ConcurrentModificationExceptions in SparkContext init.]
dc9ce16 Wed Oct 30 17:01:56 2013 -0700
Merge pull request #126 from kayousterhout/local_fix
[Fixed incorrect log message in local scheduler]
33de11c Wed Oct 30 16:58:27 2013 -0700
Merge pull request #124 from tgravescs/sparkHadoopUtilFix
[Pull SparkHadoopUtil out of SparkEnv (jira SPARK-886)]
a0c86c3 Wed Oct 30 15:34:39 2013 -0700
Merge pull request #38 from jegonzal/Documentation
[Improving Documentation]
618c1f6 Wed Oct 30 12:03:44 2013 -0700
Merge pull request #125 from velvia/2013-10/local-jar-uri
[Add support for local:// URI scheme for addJars()]
745dc42 Tue Oct 29 23:47:10 2013 -0700
Merge pull request #118 from JoshRosen/blockinfo-memory-usage
[Reduce the memory footprint of BlockInfo objects]
06adf63 Tue Oct 29 16:43:46 2013 -0700
Merge pull request #33 from kellrott/master
[Fixing graph/pom.xml]
098768e Tue Oct 29 15:08:36 2013 -0700
Merge pull request #37 from jegonzal/AnalyticsCleanup
[Updated Connected Components and Pregel Docs]
f0e23a0 Tue Oct 29 01:41:44 2013 -0400
Merge pull request #119 from soulmachine/master
[A little revise for the document]
aec9bf9 Sun Oct 27 19:32:00 2013 -0700
Merge pull request #112 from kayousterhout/ui_task_attempt_id
[Display both task ID and task attempt ID in UI, and rename taskId to taskAttemptId]
d4df474 Sun Oct 27 22:11:21 2013 -0400
Merge pull request #115 from aarondav/shuffle-fix
[Eliminate extra memory usage when shuffle file consolidation is disabled]
e018f2d Sat Oct 26 11:39:15 2013 -0700
Merge pull request #113 from pwendell/master
[Improve error message when multiple assembly jars are present.]
662ee9f Sat Oct 26 11:35:59 2013 -0700
Merge pull request #114 from soulmachine/master
[A little revise for the document]
bab496c Fri Oct 25 18:28:43 2013 -0700
Merge pull request #108 from alig/master
[Changes to enable executing by using HDFS as a synchronization point between driver and executors, as well as ensuring executors exit properly.]
d307db6 Fri Oct 25 17:26:06 2013 -0700
Merge pull request #102 from tdas/transform
[Added new Spark Streaming operations]
85e2cab Fri Oct 25 14:46:06 2013 -0700
Merge pull request #111 from kayousterhout/ui_name
[Properly display the name of a stage in the UI.]
ab35ec4 Fri Oct 25 10:16:18 2013 -0700
Merge pull request #110 from pwendell/master
[Exclude jopt from kafka dependency.]
4f2c943 Thu Oct 24 22:32:02 2013 -0700
Merge pull request #109 from pwendell/master
[Adding Java/Java Streaming versions of `repartition` with associated tests]
99ad4a6 Thu Oct 24 17:08:39 2013 -0700
Merge pull request #106 from pwendell/master
[Add a `repartition` operator.]
5429d62 Thu Oct 24 11:15:55 2013 -0700
Merge pull request #107 from ScrapCodes/scala-2.10
[Updating to latest akka 2.2.3, which fixes our only failing test Driver Suite.]
6f82c42 Thu Oct 24 11:09:46 2013 -0700
Merge pull request #34 from jegonzal/AnalyticsCleanup
[Analytics Cleanup]
1dc776b Wed Oct 23 22:05:52 2013 -0700
Merge pull request #93 from kayousterhout/ui_new_state
[Show "GETTING_RESULTS" state in UI.]
c4b187d Wed Oct 23 21:56:18 2013 -0700
Merge pull request #105 from pwendell/doc-fix
[Fixing broken links in programming guide]
a098438 Wed Oct 23 18:03:08 2013 -0700
Merge pull request #103 from JoshRosen/unpersist-fix
[Add unpersist() to JavaDoubleRDD and JavaPairRDD.]
dd65964 Wed Oct 23 15:07:59 2013 -0700
Merge pull request #64 from prabeesh/master
[MQTT Adapter for Spark Streaming]
452aa36 Tue Oct 22 23:15:33 2013 -0700
Merge pull request #97 from ewencp/pyspark-system-properties
[Add classmethod to SparkContext to set system properties.]
9dfcf53 Tue Oct 22 16:01:42 2013 -0700
Merge pull request #100 from JoshRosen/spark-902
[Remove redundant Java Function call() definitions]
49d5cda Tue Oct 22 15:38:02 2013 -0700
Merge pull request #30 from jegonzal/VertexSetRDD_Tests
[Testing and Documenting VertexSetRDD]
97184de Tue Oct 22 13:10:14 2013 -0700
Merge pull request #99 from pwendell/master
[Use correct formatting for comments in StoragePerfTester]
c404adb Tue Oct 22 11:30:19 2013 -0700
Merge pull request #90 from pwendell/master
[SPARK-940: Do not directly pass Stage objects to SparkListener.]
aa9019f Tue Oct 22 10:30:02 2013 -0700
Merge pull request #98 from aarondav/docs
[Docs: Fix links to RDD API documentation]
a0e08f0 Tue Oct 22 10:20:43 2013 -0700
Merge pull request #82 from JoshRosen/map-output-tracker-refactoring
[Split MapOutputTracker into Master/Worker classes]
b84193c Mon Oct 21 23:35:13 2013 -0700
Merge pull request #92 from tgravescs/sparkYarnFixClasspath
[Fix the Worker to use CoarseGrainedExecutorBackend and modify classpath ...]
731c94e Mon Oct 21 23:31:38 2013 -0700
Merge pull request #56 from jerryshao/kafka-0.8-dev
[Upgrade Kafka 0.7.2 to Kafka 0.8.0-beta1 for Spark Streaming]
48952d6 Mon Oct 21 22:45:00 2013 -0700
Merge pull request #87 from aarondav/shuffle-base
[Basic shuffle file consolidation]
a51359c Mon Oct 21 20:33:29 2013 -0700
Merge pull request #95 from aarondav/perftest
[Minor: Put StoragePerfTester in org/apache/]
39d2e9b Mon Oct 21 18:58:48 2013 -0700
Merge pull request #94 from aarondav/mesos-fix
[Fix mesos urls]
aa61bfd Mon Oct 21 11:57:05 2013 -0700
Merge pull request #88 from rxin/clean
[Made the following traits/interfaces/classes non-public:]
35886f3 Sun Oct 20 22:20:32 2013 -0700
Merge pull request #41 from pwendell/shuffle-benchmark
[Provide Instrumentation for Shuffle Write Performance]
5b9380e Sun Oct 20 21:03:51 2013 -0700
Merge pull request #89 from rxin/executor
[Don't setup the uncaught exception handler in local mode.]
261bcf2 Sun Oct 20 17:59:51 2013 -0700
Merge pull request #80 from rxin/build
[Exclusion rules for Maven build files.]
edc5e3f Sun Oct 20 17:18:06 2013 -0700
Merge pull request #75 from JoshRosen/block-manager-cleanup
[Code de-duplication in BlockManager]
2a7ae17 Sun Oct 20 11:45:21 2013 -0700
Merge pull request #84 from rxin/kill1
[Added documentation for setJobGroup. Also some minor cleanup in SparkContext.]
e4abb75 Sun Oct 20 09:38:37 2013 -0700
Merge pull request #85 from rxin/clean
[Moved the top level spark package object from spark to org.apache.spark]
136b9b3 Sun Oct 20 02:58:26 2013 -0700
Basic shuffle file consolidation
[The Spark shuffle phase can produce a large number of files, as one file is created]
747f538 Sat Oct 19 23:40:40 2013 -0700
Merge pull request #83 from ewencp/pyspark-accumulator-add-method
[Add an add() method to pyspark accumulators.]
6511bbe Sat Oct 19 11:34:56 2013 -0700
Merge pull request #78 from mosharaf/master
[Removed BitTorrentBroadcast and TreeBroadcast.]
f628804 Fri Oct 18 23:19:42 2013 -0700
Merge pull request #76 from pwendell/master
[Clarify compression property.]
599dcb0 Fri Oct 18 22:49:00 2013 -0700
Merge pull request #74 from rxin/kill
[Job cancellation via job group id.]
9cf43cf Fri Oct 18 22:07:21 2013 -0700
Merge pull request #28 from jegonzal/VertexSetRDD
[Refactoring IndexedRDD to VertexSetRDD.]
f888a5b Fri Oct 18 22:06:58 2013 -0700
Merge pull request #29 from ankurdave/unit-tests
[Unit tests for Graph and GraphOps]
8de9706 Fri Oct 18 20:32:39 2013 -0700
Merge pull request #66 from shivaram/sbt-assembly-deps
[Add SBT target to assemble dependencies]
e5316d0 Fri Oct 18 20:30:56 2013 -0700
Merge pull request #68 from mosharaf/master
[Faster and stable/reliable broadcast]
8d528af Fri Oct 18 20:24:10 2013 -0700
Merge pull request #71 from aarondav/scdefaults
[Spark shell exits if it cannot create SparkContext]
0794bd7 Fri Oct 18 18:59:58 2013 -0700
Merge pull request #27 from jegonzal/removed_indexedrdd_from_core
[Removing IndexedRDD changes for spark/core]
099977f Thu Oct 17 14:17:08 2013 -0700
Merge pull request #26 from ankurdave/split-vTableReplicated
[Great work!]
fc26e5b Thu Oct 17 13:21:07 2013 -0700
Merge pull request #69 from KarthikTunga/master
[Fix for issue SPARK-627. Implementing --config argument in the scripts.]
cf64f63 Thu Oct 17 11:12:28 2013 -0700
Merge pull request #67 from kayousterhout/remove_tsl
[Removed TaskSchedulerListener interface.]
f9973ca Wed Oct 16 15:58:41 2013 -0700
Merge pull request #65 from tgravescs/fixYarn
[Fix yarn build]
28e9c2a Tue Oct 15 23:59:56 2013 -0700
Merge pull request #63 from pwendell/master
[Fixing spark streaming example and a bug in examples build.]
4e46fde Tue Oct 15 23:14:27 2013 -0700
Merge pull request #62 from harveyfeng/master
[Make TaskContext's stageId publicly accessible.]
b534606 Tue Oct 15 21:25:03 2013 -0700
Merge pull request #8 from vchekan/checkpoint-ttl-restore
[Serialize and restore spark.cleaner.ttl to savepoint]
6dbd220 Tue Oct 15 19:02:57 2013 -0700
Merge pull request #34 from kayousterhout/rename
[Renamed StandaloneX to CoarseGrainedX.]
983b83f Tue Oct 15 19:02:46 2013 -0700
Merge pull request #61 from kayousterhout/daemon_thread
[Unified daemon thread pools]
3249e0e Tue Oct 15 14:12:33 2013 -0700
Merge pull request #59 from rxin/warning
[Bump up logging level to warning for failed tasks.]
678dec6 Tue Oct 15 10:51:46 2013 -0700
Merge pull request #58 from hsaputra/update-pom-asf
[Update pom.xml to use version 13 of the ASF parent pom]
e33b183 Mon Oct 14 22:25:47 2013 -0700
Merge pull request #29 from rxin/kill
[Job killing]
3b11f43 Mon Oct 14 14:20:01 2013 -0700
Merge pull request #57 from aarondav/bid
[Refactor BlockId into an actual type]
9979690 Sat Oct 12 21:23:26 2013 -0700
Merge pull request #52 from harveyfeng/hadoop-closure
[Add an optional closure parameter to HadoopRDD instantiation to use when creating local JobConfs.]
dca8009 Fri Oct 11 16:08:15 2013 -0700
Merge pull request #54 from aoiwelle/remove_unused_imports
[Remove unnecessary mutable imports]
0e5052b Fri Oct 11 15:45:16 2013 -0700
Merge pull request #51 from ScrapCodes/scala-2.10
[Scala 2.10]
fb25f32 Fri Oct 11 15:44:43 2013 -0700
Merge pull request #53 from witgo/master
[Add a zookeeper compile dependency to fix build in maven]
d6ead47 Fri Oct 11 15:43:01 2013 -0700
Merge pull request #32 from mridulm/master
[Address review comments, move to incubator spark]
c71499b Thu Oct 10 17:16:42 2013 -0700
Merge pull request #19 from aarondav/master-zk
[Standalone Scheduler fault tolerance using ZooKeeper]
5867a82 Thu Oct 10 14:02:37 2013 -0700
Merge pull request #19 from dcrankshaw/master
[Merge canonical 2d partitioner and group edges into benchmarks]
cd08f73 Thu Oct 10 13:55:47 2013 -0700
Merge pull request #44 from mateiz/fast-map
[A fast and low-memory append-only map for shuffle operations]
4b46d51 Thu Oct 10 13:35:36 2013 -0700
Merge pull request #17 from amplab/product2
[product 2 change]
320418f Wed Oct 9 16:55:30 2013 -0700
Merge pull request #49 from mateiz/kryo-fix-2
[Fix Chill serialization of Range objects]
215238c Wed Oct 9 16:49:44 2013 -0700
Merge pull request #50 from kayousterhout/SPARK-908
[Fix race condition in SparkListenerSuite (fixes SPARK-908).]
7827efc Wed Oct 9 15:07:25 2013 -0700
Merge pull request #46 from mateiz/py-sort-update
[Fix PySpark docs and an overly long line of code after #38]
7b3ae04 Wed Oct 9 12:14:19 2013 -0700
Merge pull request #45 from pwendell/metrics_units
[Use standard abbreviation in metrics description (MBytes -> MB)]
b4fa11f Wed Oct 9 11:59:47 2013 -0700
Merge pull request #38 from AndreSchumacher/pyspark_sorting
[SPARK-705: implement sortByKey() in PySpark]
19d445d Wed Oct 9 11:08:34 2013 -0700
Merge pull request #22 from GraceH/metrics-naming
[SPARK-900 Use coarser grained naming for metrics]
7d50f9f Wed Oct 9 10:32:42 2013 -0700
Merge pull request #35 from MartinWeindel/scala-2.10
[Fixing inconsistencies and warnings on Scala 2.10 branch]
3218fa7 Tue Oct 8 23:44:55 2013 -0700
Merge pull request #4 from MLnick/implicit-als
[Adding algorithm for implicit feedback data to ALS]
e67d5b9 Tue Oct 8 22:57:38 2013 -0700
Merge pull request #43 from mateiz/kryo-fix
[Don't allocate Kryo buffers unless needed]
ea34c52 Mon Oct 7 20:45:58 2013 -0700
Merge pull request #42 from pwendell/shuffle-read-perf
[Fix inconsistent and incorrect log messages in shuffle read path]
02f37ee Mon Oct 7 15:48:52 2013 -0700
Merge pull request #39 from pwendell/master
[Adding Shark 0.7.1 to EC2 scripts]
213b70a Mon Oct 7 10:54:22 2013 -0700
Merge pull request #31 from sundeepn/branch-0.8
[Resolving package conflicts with hadoop 0.23.9]
d585613 Sat Oct 5 22:57:05 2013 -0700
Merge pull request #37 from pwendell/merge-0.8
[merge in remaining changes from `branch-0.8`]
4a25b11 Sat Oct 5 19:28:55 2013 -0700
Merge pull request #20 from harveyfeng/hadoop-config-cache
[Allow users to pass broadcasted Configurations and cache InputFormats across Hadoop file reads.]
8fc68d0 Sat Oct 5 17:24:35 2013 -0700
Merge pull request #36 from pwendell/versions
[Bumping EC2 default version in master to .]
100222b Sat Oct 5 13:38:59 2013 -0700
Merge pull request #27 from davidmccauley/master
[SPARK-920/921 - JSON endpoint updates]
0864193 Sat Oct 5 13:25:18 2013 -0700
Merge pull request #33 from AndreSchumacher/pyspark_partition_key_change
[Fixing SPARK-602: PythonPartitioner]
61ffcde Fri Oct 4 10:52:17 2013 -0700
Merge pull request #15 from dcrankshaw/master
[Add synthetic generators]
3fe12cc Fri Oct 4 10:51:28 2013 -0700
Merge pull request #946 from ScrapCodes/scala-2.10
[Fixed non termination of Executor backend, when sc.stop is not called and system.exit instead.]
232765f Thu Oct 3 12:00:48 2013 -0700
Merge pull request #26 from Du-Li/master
[fixed a wildcard bug in make-distribution.sh; ask sbt to check local]
405e69b Thu Oct 3 10:52:41 2013 -0700
Merge pull request #25 from CruncherBigData/master
[Update README: updated the link]
49dbfcc Thu Oct 3 10:52:06 2013 -0700
Merge pull request #28 from tgravescs/sparYarnAppName
[Allow users to set the application name for Spark on Yarn]
e597ea3 Wed Oct 2 21:14:24 2013 -0700
Merge pull request #10 from kayousterhout/results_through-bm
[Send Task results through the block manager when larger than Akka frame size (fixes SPARK-669).]
714fdab Thu Sep 26 14:28:55 2013 -0700
Merge pull request #17 from rxin/optimize
[Remove -optimize flag]
13eced7 Thu Sep 26 14:18:19 2013 -0700
Merge pull request #16 from pwendell/master
[Bug fix in master build]
70a0b99 Thu Sep 26 14:11:54 2013 -0700
Merge pull request #14 from kayousterhout/untangle_scheduler
[Improved organization of scheduling packages.]
afd03b2 Thu Sep 26 14:09:55 2013 -0700
Merge pull request #943 from ScrapCodes/scala-2.10
[Scala 2.10 with akka 2.2]
76677b8 Thu Sep 26 14:03:46 2013 -0700
Merge pull request #670 from jey/ec2-ssh-improvements
[EC2 SSH improvements]
c514cd1 Thu Sep 26 13:48:20 2013 -0700
Merge pull request #930 from holdenk/master
[Add mapPartitionsWithIndex]
560ee5c Thu Sep 26 11:27:34 2013 -0700
Merge pull request #7 from wannabeast/memorystore-fixes
[some minor fixes to MemoryStore]
6566a19 Thu Sep 26 08:01:04 2013 -0700
Merge pull request #9 from rxin/limit
[Smarter take/limit implementation.]
834686b Sun Sep 22 15:06:48 2013 -0700
Merge pull request #928 from jerryshao/fairscheduler-refactor
[Refactor FairSchedulableBuilder]
a2ea069 Sat Sep 21 23:04:42 2013 -0700
Merge pull request #937 from jerryshao/localProperties-fix
[Fix PR926 local properties issues in Spark Streaming like scenarios]
f06f2da Sat Sep 21 22:43:34 2013 -0700
Merge pull request #941 from ilikerps/master
[Add "org.apache." prefix to packages in spark-class]
7bb12a2 Sat Sep 21 22:42:46 2013 -0700
Merge pull request #940 from ankurdave/clear-port-properties-after-tests
[After unit tests, clear port properties unconditionally]
a00317b Fri Sep 20 11:29:31 2013 -0700
Merge pull request #1 from ankurdave/aggregateNeighbors-returns-graph
[Return Graph from Graph.aggregateNeighbors]
6a5e665 Thu Sep 19 22:41:44 2013 -0700
Merge pull request #3 from ankurdave/clear-port-properties-after-tests
[After unit tests, clear port properties unconditionally ]
68ad33a Thu Sep 19 21:30:27 2013 -0700
Merge pull request #2 from ankurdave/package-fixes
[Package fixes (spark.graph -> org.apache.spark.graph)]
cd7222c Thu Sep 19 14:21:24 2013 -0700
Merge pull request #938 from ilikerps/master
[Fix issue with spark_ec2 seeing empty security groups]
e0dd24d Sat Aug 31 17:54:15 2013 -0700
Merge pull request #879 from AndreSchumacher/scala-2.10
[PySpark: replacing class manifest by class tag for Scala 2.10.2 in rdd.py]
ad61349 Thu Jul 18 13:53:48 2013 -0700
Merge pull request #709 from ScrapCodes/scala-2.10
[Fixed warnings in scala 2.10 branch.]
a289ded Mon Jul 15 15:59:43 2013 -0700
Merge pull request #700 from ScrapCodes/scala-2.10
[Scala 2.10 ]
1044a95 Fri Jun 14 20:04:24 2013 -0700
Merge pull request #652 from ScrapCodes/scala-2.10
[Fixed maven build without netty fix]
4b57f83 Sat Apr 20 10:40:07 2013 -0700
Merge pull request #535 from ScrapCodes/scala-2.10-repl-port
[porting of repl to scala-2.10]
73b3fee Sun Jan 20 10:11:49 2013 -0800
Merge pull request #388 from folone/master
[Updated maven build configuration for Scala 2.10]
20adf27 Tue Jan 15 11:03:49 2013 -0800
Merge pull request #371 from folone/master
[Scala 2.10.0]
Release 0.8.0-incubating
2aff798 Sun Sep 15 14:05:04 2013 -0700
Merge pull request #933 from jey/yarn-typo-fix
[Fix typo in Maven build docs]
dbd2c4f Sun Sep 15 13:20:41 2013 -0700
Merge pull request #932 from pwendell/mesos-version
[Bumping Mesos version to 0.13.0]
9fb0b9d Sun Sep 15 13:02:53 2013 -0700
Merge pull request #931 from pwendell/yarn-docs
[Explain yarn.version in Maven build docs]
c4c1db2 Fri Sep 13 19:52:12 2013 -0700
Merge pull request #929 from pwendell/master
[Use different Hadoop version for YARN artifacts.]
a310de6 Wed Sep 11 19:36:11 2013 -0700
Merge pull request #926 from kayousterhout/dynamic
[Changed localProperties to use ThreadLocal (not DynamicVariable).]
58c7d8b Wed Sep 11 17:33:42 2013 -0700
Merge pull request #927 from benh/mesos-docs
[Updated Spark on Mesos documentation.]
91a59e6 Wed Sep 11 10:21:48 2013 -0700
Merge pull request #919 from mateiz/jets3t
[Add explicit jets3t dependency, which is excluded in hadoop-client]
b9128d3 Wed Sep 11 10:03:06 2013 -0700
Merge pull request #922 from pwendell/port-change
[Change default port number from 3030 to 4030.]
e07eef8 Wed Sep 11 07:35:39 2013 -0700
Merge pull request #925 from davidmccauley/master
[SPARK-894 - Not all WebUI fields delivered VIA JSON]
8432f27 Tue Sep 10 23:19:53 2013 -0700
Merge pull request #923 from haoyuan/master
[fix run-example script]
d40f140 Tue Sep 10 23:05:29 2013 -0700
Merge pull request #921 from pwendell/master
[Fix HDFS access bug with assembly build.]
0a6c051 Mon Sep 9 23:37:57 2013 -0700
Merge pull request #918 from pwendell/branch-0.8
[Update versions for 0.8.0 release.]
8c14f4b Mon Sep 9 22:07:58 2013 -0700
Merge pull request #917 from pwendell/master
[Document libgfortran dependency for MLBase]
c81377b Mon Sep 9 20:16:19 2013 -0700
Merge pull request #915 from ooyala/master
[Get rid of / improve ugly NPE when Utils.deleteRecursively() fails]
61d2a01 Mon Sep 9 18:21:01 2013 -0700
Merge pull request #916 from mateiz/mkdist-fix
[Fix copy issue in https://github.com/mesos/spark/pull/899]
a85758c Mon Sep 9 13:45:40 2013 -0700
Merge pull request #907 from stephenh/document_coalesce_shuffle
[Add better docs for coalesce.]
084fc36 Mon Sep 9 12:01:35 2013 -0700
Merge pull request #912 from tgravescs/ganglia-pom
[Add metrics-ganglia to core pom file]
0456384 Mon Sep 9 09:57:54 2013 -0700
Merge pull request #911 from pwendell/ganglia-sink
[Adding Manen dependency for Ganglia]
bf984e2 Sun Sep 8 23:50:24 2013 -0700
Merge pull request #890 from mridulm/master
[Fix hash bug]
e9d4f44 Sun Sep 8 23:36:48 2013 -0700
Merge pull request #909 from mateiz/exec-id-fix
[Fix an instance where full standalone mode executor IDs were passed to]
2447b1c Sun Sep 8 22:27:49 2013 -0700
Merge pull request #910 from mateiz/ml-doc-tweaks
[Small tweaks to MLlib docs]
7d3204b Sun Sep 8 21:39:12 2013 -0700
Merge pull request #905 from mateiz/docs2
[Job scheduling and cluster mode docs]
f1f8371 Sun Sep 8 21:26:11 2013 -0700
Merge pull request #896 from atalwalkar/master
[updated content]
f68848d Sun Sep 8 18:32:16 2013 -0700
Merge pull request #906 from pwendell/ganglia-sink
[Clean-up of Metrics Code/Docs and Add Ganglia Sink]
0b95799 Sun Sep 8 15:30:16 2013 -0700
Merge pull request #908 from pwendell/master
[Fix target JVM version in scala build]
04cfb3a Sun Sep 8 10:33:20 2013 -0700
Merge pull request #898 from ilikerps/660
[SPARK-660: Add StorageLevel support in Python]
38488ac Sun Sep 8 00:28:53 2013 -0700
Merge pull request #900 from pwendell/cdh-docs
[Provide docs to describe running on CDH/HDP cluster.]
a8e376e Sat Sep 7 21:16:01 2013 -0700
Merge pull request #904 from pwendell/master
[Adding Apache license to two files]
cfde85e Sat Sep 7 13:53:08 2013 -0700
Merge pull request #901 from ooyala/2013-09/0.8-doc-changes
[0.8 Doc changes for make-distribution.sh]
4a7813a Sat Sep 7 13:52:24 2013 -0700
Merge pull request #903 from rxin/resulttask
[Fixed the bug that ResultTask was not properly deserializing outputId.]
afe46ba Sat Sep 7 07:28:51 2013 -0700
Merge pull request #892 from jey/fix-yarn-assembly
[YARN build fixes]
2eebeff Fri Sep 6 15:25:22 2013 -0700
Merge pull request #897 from pwendell/master
[Docs describing Spark monitoring and instrumentation]
ddcb9d3 Thu Sep 5 23:54:09 2013 -0700
Merge pull request #895 from ilikerps/821
[SPARK-821: Don't cache results when action run locally on driver]
699c331 Thu Sep 5 20:21:53 2013 -0700
Merge pull request #891 from xiajunluan/SPARK-864
[[SPARK-864]DAGScheduler Exception if we delete Worker and StandaloneExecutorBackend then add Worker]
5c7494d Wed Sep 4 22:47:03 2013 -0700
Merge pull request #893 from ilikerps/master
[SPARK-884: Add unit test to validate Spark JSON output]
a547866 Wed Sep 4 21:11:56 2013 -0700
Merge pull request #894 from c0s/master
[Updating assembly README to reflect recent changes in the build.]
19f7027 Tue Sep 3 14:29:10 2013 -0700
Merge pull request #878 from tgravescs/yarnUILink
[Link the Spark UI up to the Yarn UI ]
68df246 Tue Sep 3 13:01:17 2013 -0700
Merge pull request #889 from alig/master
[Return the port the WebUI is bound to (useful if port 0 was used)]
d3dd48f Mon Sep 2 16:44:54 2013 -0700
Merge pull request #887 from mateiz/misc-fixes
[Miscellaneous fixes for 0.8]
636fc0c Mon Sep 2 11:20:39 2013 -0700
Merge pull request #886 from mateiz/codec
[Fix spark.io.compression.codec and change default codec to LZF]
d9a53b9 Sun Sep 1 22:12:30 2013 -0700
Merge pull request #885 from mateiz/win-py
[Allow PySpark to run on Windows]
3c520fe Sun Sep 1 17:26:55 2013 -0700
Merge pull request #884 from mateiz/win-fixes
[Run script fixes for Windows after package & assembly change]
f957c26 Sun Sep 1 14:53:57 2013 -0700
Merge pull request #882 from mateiz/package-rename
[Rename spark package to org.apache.spark]
a30fac1 Sun Sep 1 12:27:50 2013 -0700
Merge pull request #883 from alig/master
[Don't require the spark home environment variable to be set for standalone mode (change needed by SIMR)]
03cc765 Sun Sep 1 10:20:56 2013 -0700
Merge pull request #881 from pwendell/master
[Extend QuickStart to include next steps]
0e9565a Sat Aug 31 18:55:41 2013 -0700
Merge pull request #880 from mateiz/ui-tweaks
[Various UI tweaks]
2b29a1d Sat Aug 31 17:49:45 2013 -0700
Merge pull request #877 from mateiz/docs
[Doc improvements for 0.8]
6edef9c Sat Aug 31 13:39:24 2013 -0700
Merge pull request #861 from AndreSchumacher/pyspark_sampling_function
[Pyspark sampling function]
fd89835 Sat Aug 31 13:18:12 2013 -0700
Merge pull request #870 from JoshRosen/spark-885
[Don't send SIGINT / ctrl-c to Py4J gateway subprocess]
618f0ec Fri Aug 30 18:17:13 2013 -0700
Merge pull request #869 from AndreSchumacher/subtract
[PySpark: implementing subtractByKey(), subtract() and keyBy()]
94bb7fd Fri Aug 30 12:05:13 2013 -0700
Merge pull request #876 from mbautin/master_hadoop_rdd_conf
[Make HadoopRDD's configuration accessible]
9e17e45 Fri Aug 30 00:22:53 2013 -0700
Merge pull request #875 from shivaram/build-fix
[Fix broken build by removing addIntercept]
016787d Thu Aug 29 22:15:14 2013 -0700
Merge pull request #863 from shivaram/etrain-ridge
[Adding linear regression and refactoring Ridge regression to use SGD]
852d810 Thu Aug 29 22:13:15 2013 -0700
Merge pull request #819 from shivaram/sgd-cleanup
[Change SVM to use {0,1} labels]
ca71620 Thu Aug 29 21:51:14 2013 -0700
Merge pull request #857 from mateiz/assembly
[Change build and run instructions to use assemblies]
1528776 Thu Aug 29 21:30:47 2013 -0700
Merge pull request #874 from jerryshao/fix-report-bug
[Fix removed block zero size log reporting]
abdbacf Wed Aug 28 21:11:31 2013 -0700
Merge pull request #871 from pwendell/expose-local
[Expose `isLocal` in SparkContext.]
afcade3 Wed Aug 28 20:15:40 2013 -0700
Merge pull request #873 from pwendell/master
[Hot fix for command runner]
baa84e7 Wed Aug 28 12:44:46 2013 -0700
Merge pull request #865 from tgravescs/fixtmpdir
[Spark on Yarn should use yarn approved directories for spark.local.dir and tmp]
cd043cf Tue Aug 27 19:50:32 2013 -0700
Merge pull request #867 from tgravescs/yarnenvconfigs
[Spark on Yarn allow users to specify environment variables ]
898da7e Mon Aug 26 20:40:49 2013 -0700
Merge pull request #859 from ianbuss/sbt_opts
[Pass SBT_OPTS environment through to sbt_launcher]
17bafea Mon Aug 26 11:59:32 2013 -0700
Merge pull request #864 from rxin/json1
[Revert json library change]
f9fc5c1 Sat Aug 24 15:19:56 2013 -0700
Merge pull request #603 from pwendell/ec2-updates
[Several Improvements to EC2 Scripts]
d282c1e Fri Aug 23 11:20:20 2013 -0700
Merge pull request #860 from jey/sbt-ide-fixes
[Fix IDE project generation under SBT]
5a6ac12 Thu Aug 22 22:08:03 2013 -0700
Merge pull request #701 from ScrapCodes/documentation-suggestions
[Documentation suggestions for spark streaming.]
46ea0c1 Thu Aug 22 15:57:28 2013 -0700
Merge pull request #814 from holdenk/master
[Create less instances of the random class during ALS initialization.]
9ac3d62 Thu Aug 22 15:51:10 2013 -0700
Merge pull request #856 from jey/sbt-fix-hadoop-0.23.9
[Re-add removed dependency to fix build under Hadoop 0.23.9]
ae8ba83 Thu Aug 22 10:14:54 2013 -0700
Merge pull request #855 from jey/update-build-docs
[Update build docs]
8a36fd0 Thu Aug 22 10:13:35 2013 -0700
Merge pull request #854 from markhamstra/pomUpdate
[Synced sbt and maven builds to use the same dependencies, etc.]
c2d00f1 Thu Aug 22 10:13:03 2013 -0700
Merge pull request #832 from alig/coalesce
[Coalesced RDD with locality]
e6d66c8 Wed Aug 21 17:44:31 2013 -0700
Merge pull request #853 from AndreSchumacher/double_rdd
[Implementing SPARK-838: Add DoubleRDDFunctions methods to PySpark]
2905611 Tue Aug 20 17:36:14 2013 -0700
Merge pull request #851 from markhamstra/MutablePairTE
[Removed meaningless types]
d61337f Tue Aug 20 10:06:06 2013 -0700
Merge pull request #844 from markhamstra/priorityRename
[Renamed 'priority' to 'jobId' and assorted minor changes]
8cae72e Mon Aug 19 23:40:04 2013 -0700
Merge pull request #828 from mateiz/sched-improvements
[Scheduler fixes and improvements]
efeb142 Mon Aug 19 19:23:50 2013 -0700
Merge pull request #849 from mateiz/web-fixes
[Small fixes to web UI]
abdc1f8 Mon Aug 19 18:30:56 2013 -0700
Merge pull request #847 from rxin/rdd
[Allow subclasses of Product2 in all key-value related classes]
8fa0747 Sun Aug 18 17:02:54 2013 -0700
Merge pull request #840 from AndreSchumacher/zipegg
[Implementing SPARK-878 for PySpark: adding zip and egg files to context ...]
1e137a5 Sat Aug 17 22:22:32 2013 -0700
Merge pull request #846 from rxin/rdd
[Two minor RDD refactoring]
e89ffc7 Fri Aug 16 14:02:34 2013 -0700
Merge pull request #839 from jegonzal/zip_partitions
[Currying RDD.zipPartitions ]
1fb1b09 Thu Aug 15 22:15:05 2013 -0700
Merge pull request #841 from rxin/json
[Use the JSON formatter from Scala library and removed dependency on lift-json.]
c69c489 Thu Aug 15 20:55:09 2013 -0700
Merge pull request #843 from Reinvigorate/bug-879
[fixing typo in conf/slaves]
230ab27 Thu Aug 15 17:45:17 2013 -0700
Merge pull request #834 from Daemoen/master
[Updated json output to allow for display of worker state]
659553b Thu Aug 15 16:56:31 2013 -0700
Merge pull request #836 from pwendell/rename
[Rename `memoryBytesToString` and `memoryMegabytesToString`]
28369ff Thu Aug 15 16:44:02 2013 -0700
Merge pull request #829 from JoshRosen/pyspark-unit-tests-python-2.6
[Fix PySpark unit tests on Python 2.6]
1a13460 Thu Aug 15 15:50:44 2013 -0700
Merge pull request #833 from rxin/ui
[Various UI improvements.]
044a088 Wed Aug 14 20:43:49 2013 -0700
Merge pull request #831 from rxin/scheduler
[A few small scheduler / job description changes.]
839f2d4 Wed Aug 14 16:17:23 2013 -0700
Merge pull request #822 from pwendell/ui-features
[Adding GC Stats to TaskMetrics (and three small fixes)]
63446f9 Wed Aug 14 00:17:07 2013 -0700
Merge pull request #826 from kayousterhout/ui_fix
[Fixed 2 bugs in executor UI (incl. SPARK-877)]
3f14cba Tue Aug 13 20:09:51 2013 -0700
Merge pull request #825 from shivaram/maven-repl-fix
[Set SPARK_CLASSPATH for maven repl tests]
596adc6 Tue Aug 13 19:41:34 2013 -0700
Merge pull request #824 from mateiz/mesos-0.12.1
[Update to Mesos 0.12.1]
d316af9 Tue Aug 13 15:31:01 2013 -0700
Merge pull request #821 from pwendell/print-launch-command
[Print run command to stderr rather than stdout]
1f79d21 Tue Aug 13 15:23:54 2013 -0700
Merge pull request #818 from kayousterhout/killed_fix
[Properly account for killed tasks.]
622f83c Tue Aug 13 09:58:52 2013 -0700
Merge pull request #817 from pwendell/pr_784
[Minor clean-up in metrics servlet code]
a0133bf Tue Aug 13 09:28:18 2013 -0700
Merge pull request #784 from jerryshao/dev-metrics-servlet
[Add MetricsServlet for Spark metrics system]
e2fdac6 Mon Aug 12 21:26:59 2013 -0700
Merge pull request #802 from stayhf/SPARK-760-Python
[Simple PageRank algorithm implementation in Python for SPARK-760]
d3525ba Mon Aug 12 21:02:39 2013 -0700
Merge pull request #813 from AndreSchumacher/add_files_pyspark
[Implementing SPARK-865: Add the equivalent of ADD_JARS to PySpark]
9e02da2 Mon Aug 12 20:22:27 2013 -0700
Merge pull request #812 from shivaram/maven-mllib-tests
[Create SparkContext in beforeAll for MLLib tests]
65d0d91 Mon Aug 12 19:00:57 2013 -0700
Merge pull request #807 from JoshRosen/guava-optional
[Change scala.Option to Guava Optional in Java APIs]
4346f0a Mon Aug 12 12:12:12 2013 -0700
Merge pull request #809 from shivaram/sgd-cleanup
[Clean up scaladoc in ML Lib.]
ea1b4ba Mon Aug 12 08:09:58 2013 -0700
Merge pull request #806 from apivovarov/yarn-205
[Changed yarn.version to 2.0.5 in pom.xml]
2a39d2c Sun Aug 11 20:35:09 2013 -0700
Merge pull request #810 from pwendell/dead_doc_code
[Remove now dead code inside of docs]
e5b9ed2 Sun Aug 11 17:22:47 2013 -0700
Merge pull request #808 from pwendell/ui_compressed_bytes
[Report compressed bytes read when calculating TaskMetrics]
3796486 Sun Aug 11 14:51:47 2013 -0700
Merge pull request #805 from woggle/hadoop-rdd-jobconf
[Use new Configuration() instead of slower new JobConf() in SerializableWritable]
ff9ebfa Sun Aug 11 10:52:55 2013 -0700
Merge pull request #762 from shivaram/sgd-cleanup
[Refactor SGD options into a new class.]
95c62ca Sun Aug 11 10:30:52 2013 -0700
Merge pull request #804 from apivovarov/master
[Fixed path to JavaALS.java and JavaKMeans.java, fixed hadoop2-yarn profi...]
06e4f2a Sat Aug 10 18:06:23 2013 -0700
Merge pull request #789 from MLnick/master
[Adding Scala version of PageRank example]
71c63de Sat Aug 10 10:21:20 2013 -0700
Merge pull request #795 from mridulm/master
[Fix bug reported in PR 791 : a race condition in ConnectionManager and Connection]
d17eeb9 Sat Aug 10 09:02:27 2013 -0700
Merge pull request #785 from anfeng/master
[expose HDFS file system stats via Executor metrics]
dce5e47 Fri Aug 9 21:53:45 2013 -0700
Merge pull request #800 from dlyubimov/HBASE_VERSION
[Pull HBASE_VERSION in the head of sbt build]
cd247ba Fri Aug 9 20:41:13 2013 -0700
Merge pull request #786 from shivaram/mllib-java
[Java fixes, tests and examples for ALS, KMeans]
b09d4b7 Fri Aug 9 13:17:08 2013 -0700
Merge pull request #799 from woggle/sync-fix
[Remove extra synchronization in ResultTask]
0bc63bf Fri Aug 9 13:16:25 2013 -0700
Merge pull request #801 from pwendell/print-launch-command
[Print launch command [Branch 0.8 version]]
cc6b92e Fri Aug 9 13:00:33 2013 -0700
Merge pull request #775 from pwendell/print-launch-command
[Log the launch command for Spark daemons]
f94fc75 Fri Aug 9 10:04:03 2013 -0700
Merge pull request #788 from shane-huang/sparkjavaopts
[For standalone mode, add worker local env setting of SPARK_JAVA_OPTS as ...]
63b6e02 Thu Aug 8 14:02:02 2013 -0700
Merge pull request #797 from mateiz/chill-0.3.1
[Update to Chill 0.3.1]
9955e5a Thu Aug 8 11:03:38 2013 -0700
Merge pull request #796 from pwendell/bootstrap-design
[Bootstrap re-design]
5133e4b Wed Aug 7 15:50:45 2013 -0700
Merge pull request #790 from kayousterhout/fix_throughput
[Fixed issue in UI that decreased scheduler throughput by 5x or more]
3c8478e Tue Aug 6 23:25:03 2013 -0700
Merge pull request #747 from mateiz/improved-lr
[Update the Python logistic regression example]
6b043a6 Tue Aug 6 22:31:02 2013 -0700
Merge pull request #724 from dlyubimov/SPARK-826
[SPARK-826: fold(), reduce(), collect() always attempt to use java serialization]
de6c4c9 Tue Aug 6 17:09:50 2013 -0700
Merge pull request #787 from ash211/master
[Update spark-standalone.md]
df4d10d Tue Aug 6 15:44:05 2013 -0700
Merge pull request #779 from adatao/adatao-global-SparkEnv
[[HOTFIX] Extend thread safety for SparkEnv.get()]
d2b0f0c Tue Aug 6 14:49:39 2013 -0700
Merge pull request #770 from stayhf/SPARK-760-Java
[Simple PageRank algorithm implementation in Java for SPARK-760]
d031f73 Mon Aug 5 22:33:00 2013 -0700
Merge pull request #782 from WANdisco/master
[SHARK-94 Log the files computed by HadoopRDD and NewHadoopRDD]
1b63dea Mon Aug 5 22:21:26 2013 -0700
Merge pull request #769 from markhamstra/NegativeCores
[SPARK-847 + SPARK-845: Zombie workers and negative cores]
828aff7 Mon Aug 5 21:37:33 2013 -0700
Merge pull request #776 from gingsmith/master
[adding matrix factorization data generator]
8b27789 Mon Aug 5 19:14:52 2013 -0700
Merge pull request #774 from pwendell/job-description
[Show user-defined job name in UI]
550b0cf Mon Aug 5 12:10:32 2013 -0700
Merge pull request #780 from cybermaster/master
[SPARK-850]
22abbc1 Fri Aug 2 16:37:59 2013 -0700
Merge pull request #772 from karenfeng/ui-843
[Show app duration]
9d7dfd2 Thu Aug 1 17:41:58 2013 -0700
Merge pull request #743 from pwendell/app-metrics
[Add application metrics to standalone master]
6d7afd7 Thu Aug 1 17:13:28 2013 -0700
Merge pull request #768 from pwendell/pr-695
[Minor clean-up of fair scheduler UI]
5e7b38f Thu Aug 1 14:59:33 2013 -0700
Merge pull request #695 from xiajunluan/pool_ui
[Enhance job ui in spark ui system with adding pool information]
0a96493 Thu Aug 1 11:27:17 2013 -0700
Merge pull request #760 from karenfeng/heading-update
[Clean up web UI page headers]
cb7dd86 Thu Aug 1 11:06:10 2013 -0700
Merge pull request #758 from pwendell/master-json
[Add JSON path to master index page]
58756b7 Wed Jul 31 23:45:41 2013 -0700
Merge pull request #761 from mateiz/kmeans-generator
[Add data generator for K-means]
ecab635 Wed Jul 31 18:16:55 2013 -0700
Merge pull request #763 from c0s/assembly
[SPARK-842. Maven assembly is including examples libs and dependencies]
39c75f3 Wed Jul 31 15:52:36 2013 -0700
Merge pull request #757 from BlackNiuza/result_task_generation
[Bug fix: SPARK-837]
b2b86c2 Wed Jul 31 15:51:39 2013 -0700
Merge pull request #753 from shivaram/glm-refactor
[Build changes for ML lib]
14bf2fe Wed Jul 31 14:18:16 2013 -0700
Merge pull request #749 from benh/spark-executor-uri
[Added property 'spark.executor.uri' for launching on Mesos.]
4ba4c3f Wed Jul 31 13:14:49 2013 -0700
Merge pull request #759 from mateiz/split-fix
[Use the Char version of split() instead of the String one in MLUtils]
a386ced Wed Jul 31 11:22:50 2013 -0700
Merge pull request #754 from rxin/compression
[Compression codec change]
0be071a Wed Jul 31 11:11:59 2013 -0700
Merge pull request #756 from cdshines/patch-1
[Refactored Vector.apply(length, initializer) replacing excessive code with library method]
d4556f4 Wed Jul 31 08:48:14 2013 -0700
Merge pull request #751 from cdshines/master
[Cleaned Partitioner & PythonPartitioner source by taking out non-related logic to Utils]
29b8cd3 Tue Jul 30 21:30:33 2013 -0700
Merge pull request #755 from jerryshao/add-apache-header
[Add Apache license header to metrics system]
e87de03 Tue Jul 30 15:00:08 2013 -0700
Merge pull request #744 from karenfeng/bootstrap-update
[Use Bootstrap progress bars in web UI]
ae57020 Tue Jul 30 14:56:41 2013 -0700
Merge pull request #752 from rxin/master
[Minor mllib cleanup]
8aee118 Tue Jul 30 10:27:54 2013 -0700
Merge pull request #748 from atalwalkar/master
[made SimpleUpdater consistent with other updaters]
468a36c Mon Jul 29 19:44:33 2013 -0700
Merge pull request #746 from rxin/cleanup
[Internal cleanup]
1e1ffb1 Mon Jul 29 19:26:19 2013 -0700
Merge pull request #745 from shivaram/loss-update-fix
[Remove duplicate loss history in Gradient Descent]
c99b674 Mon Jul 29 16:32:55 2013 -0700
Merge pull request #735 from karenfeng/ui-807
[Totals for shuffle data and CPU time]
fe7298b Mon Jul 29 14:01:00 2013 -0700
Merge pull request #741 from pwendell/usability
[Fix two small usability issues]
c34c0f6 Mon Jul 29 13:18:10 2013 -0700
Merge pull request #731 from pxinghao/master
[Adding SVM and Lasso]
f3d72ff Fri Jul 26 17:19:27 2013 -0700
Merge pull request #739 from markhamstra/toolsPom
[Missing tools/pom.xml scalatest dependency]
cb36677 Fri Jul 26 16:59:30 2013 -0700
Merge pull request #738 from harsha2010/pruning
[Fix bug in Partition Pruning.]
f3cf094 Thu Jul 25 14:53:21 2013 -0700
Merge pull request #734 from woggle/executor-env2
[Get more env vars from driver rather than worker]
51c2427 Thu Jul 25 00:03:11 2013 -0700
Merge pull request #732 from ryanlecompte/master
[Refactor Kryo serializer support to use chill/chill-java]
52723b9 Wed Jul 24 14:33:02 2013 -0700
Merge pull request #728 from jey/examples-jar-env
[Fix setting of SPARK_EXAMPLES_JAR]
20338c2 Wed Jul 24 14:32:24 2013 -0700
Merge pull request #729 from karenfeng/ui-811
[Stage Page updates]
5584ebc Wed Jul 24 11:46:46 2013 -0700
Merge pull request #675 from c0s/assembly
[Building spark assembly for further consumption of the Spark project with a deployed cluster]
a73f3ee Wed Jul 24 08:59:14 2013 -0700
Merge pull request #671 from jerryshao/master
[Add metrics system for Spark]
b011329 Tue Jul 23 22:50:09 2013 -0700
Merge pull request #727 from rxin/scheduler
[Scheduler code style cleanup.]
876125b Tue Jul 23 22:28:21 2013 -0700
Merge pull request #726 from rxin/spark-826
[SPARK-829: scheduler shouldn't hang if a task contains unserializable objects in its closure]
2f1736c Tue Jul 23 15:53:30 2013 -0700
Merge pull request #725 from karenfeng/task-start
[Creates task start events]
5364f64 Tue Jul 23 13:40:34 2013 -0700
Merge pull request #723 from rxin/mllib
[Made RegressionModel serializable and added unit tests to make sure predict methods would work.]
f369e0e Tue Jul 23 13:22:27 2013 -0700
Merge pull request #720 from ooyala/2013-07/persistent-rdds-api
[Add a public method getCachedRdds to SparkContext]
401aac8 Mon Jul 22 16:57:16 2013 -0700
Merge pull request #719 from karenfeng/ui-808
[Creates Executors tab for Jobs UI]
8ae1436 Mon Jul 22 16:03:04 2013 -0700
Merge pull request #722 from JoshRosen/spark-825
[Fix bug: DoubleRDDFunctions.sampleStdev() computed non-sample stdev()]
15fb394 Sun Jul 21 10:33:38 2013 -0700
Merge pull request #716 from c0s/webui-port
[Regression: default webui-port can't be set via command line "--webui-port" anymore]
c40f0f2 Fri Jul 19 13:33:04 2013 -0700
Merge pull request #711 from shivaram/ml-generators
[Move ML lib data generator files to util/]
413b841 Fri Jul 19 13:31:38 2013 -0700
Merge pull request #717 from viirya/dev1
[Do not copy local jars given to SparkContext in yarn mode]
0d0a47c Thu Jul 18 12:06:37 2013 -0700
Merge pull request #710 from shivaram/ml-updates
[Updates to LogisticRegression]
c6235b5 Thu Jul 18 11:43:48 2013 -0700
Merge pull request #714 from adatao/master
[[BUGFIX] Fix for sbt/sbt script SPARK_HOME setting]
009c79e Thu Jul 18 11:41:52 2013 -0700
Merge pull request #715 from viirya/dev1
[fix a bug in build process that pulls in two versions of ASM.]
985a9e3 Wed Jul 17 22:27:19 2013 -0700
Merge pull request #712 from stayhf/SPARK-817
[Consistently invoke bash with /usr/bin/env bash in scripts to make code ...]
cad48ed Tue Jul 16 21:41:28 2013 -0700
Merge pull request #708 from ScrapCodes/dependencies-upgrade
[Dependency upgrade Akka 2.0.3 -> 2.0.5]
8a8a8f2 Mon Jul 15 23:09:21 2013 -0700
Merge pull request #705 from rxin/errormessages
[Throw a more meaningful message when runJob is called to launch tasks on non-existent partitions.]
ed8415b Mon Jul 15 16:41:04 2013 -0700
Merge pull request #703 from karenfeng/ui-802
[Link to job UI from standalone deploy cluster web UI]
e3d3e6f Mon Jul 15 14:59:44 2013 -0700
Merge pull request #702 from karenfeng/ui-fixes
[Adds app name in HTML page titles on job web UI]
c7877d5 Sun Jul 14 12:58:13 2013 -0700
Merge pull request #689 from BlackNiuza/application_status
[Bug fix: SPARK-796]
10c0593 Sun Jul 14 11:45:18 2013 -0700
Merge pull request #699 from pwendell/ui-env
[Add `Environment` tab to SparkUI.]
89e8549 Sat Jul 13 16:11:08 2013 -0700
Merge pull request #698 from Reinvigorate/sm-deps-change
[changing com.google.code.findbugs maven coordinates]
77c69ae Fri Jul 12 23:05:21 2013 -0700
Merge pull request #697 from pwendell/block-locations
[Show block locations in Web UI.]
5a7835c Fri Jul 12 20:28:21 2013 -0700
Merge pull request #691 from karenfeng/logpaging
[Create log pages]
71ccca0 Fri Jul 12 20:25:06 2013 -0700
Merge pull request #696 from woggle/executor-env
[Pass executor env vars (e.g. SPARK_CLASSPATH) to compute-classpath.sh]
90fc3f3 Fri Jul 12 20:23:36 2013 -0700
Merge pull request #692 from Reinvigorate/takeOrdered
[adding takeOrdered() to RDD]
018d04c Thu Jul 11 12:48:37 2013 -0700
Merge pull request #684 from woggle/mesos-classloader
[Explicitly set class loader for MesosSchedulerDriver callbacks.]
bc19477 Wed Jul 10 22:29:41 2013 -0700
Merge pull request #693 from c0s/readme
[Updating README to reflect Scala 2.9.3 requirements]
7dcda9a Mon Jul 8 23:24:23 2013 -0700
Merge pull request #688 from markhamstra/scalaDependencies
[Fixed SPARK-795 with explicit dependencies]
638927b Mon Jul 8 22:58:50 2013 -0700
Merge pull request #683 from shivaram/sbt-test-fix
[Remove some stack traces from sbt test output]
3c13178 Mon Jul 8 14:50:34 2013 -0700
Merge pull request #687 from atalwalkar/master
[Added "Labeled" to util functions for labeled data]
744da8e Sun Jul 7 17:42:25 2013 -0700
Merge pull request #679 from ryanlecompte/master
[Make binSearch method tail-recursive for RidgeRegression]
3cc6818 Sat Jul 6 19:51:20 2013 -0700
Merge pull request #668 from shimingfei/guava-14.0.1
[update guava version from 11.0.1 to 14.0.1]
2216188 Sat Jul 6 16:18:15 2013 -0700
Merge pull request #676 from c0s/asf-avro
[Use standard ASF published avro module instead of a proprietory built one]
94871e4 Sat Jul 6 15:26:19 2013 -0700
Merge pull request #655 from tgravescs/master
[Add support for running Spark on Yarn on a secure Hadoop Cluster]
3f918b3 Sat Jul 6 12:45:18 2013 -0700
Merge pull request #672 from holdenk/master
[s/ActorSystemImpl/ExtendedActorSystem/ as ActorSystemImpl results in a warning]
2a36e54 Sat Jul 6 12:43:21 2013 -0700
Merge pull request #673 from xiajunluan/master
[Add config template file for fair scheduler feature]
7ba7fa1 Sat Jul 6 11:45:08 2013 -0700
Merge pull request #674 from liancheng/master
[Bug fix: SPARK-789]
f4416a1 Sat Jul 6 11:41:58 2013 -0700
Merge pull request #681 from BlackNiuza/memory_leak
[Remove active job from idToActiveJob when job finished or aborted]
e063e29 Fri Jul 5 21:54:52 2013 -0700
Merge pull request #680 from tdas/master
[Fixed major performance bug in Network Receiver]
bf1311e Fri Jul 5 17:32:44 2013 -0700
Merge pull request #678 from mateiz/ml-examples
[Start of ML package]
6ad85d0 Thu Jul 4 21:32:29 2013 -0700
Merge pull request #677 from jerryshao/fix_stage_clean
[Clean StageToInfos periodically when spark.cleaner.ttl is enabled]
2e32fc8 Thu Jul 4 12:18:20 2013 -0700
Merge pull request #666 from c0s/master
[hbase dependency is missed in hadoop2-yarn profile of examples module
]
6d60fe5 Mon Jul 1 18:24:03 2013 -0700
Merge pull request #666 from c0s/master
[hbase dependency is missed in hadoop2-yarn profile of examples module]
ccfe953 Sat Jun 29 17:57:53 2013 -0700
Merge pull request #577 from skumargithub/master
[Example of cumulative counting using updateStateByKey]
50ca176 Thu Jun 27 22:24:52 2013 -0700
Merge pull request #664 from pwendell/test-fix
[Removing incorrect test statement]
e49bc8c Wed Jun 26 11:13:33 2013 -0700
Merge pull request #663 from stephenh/option_and_getenv
[Be cute with Option and getenv.]
f5e32ed Tue Jun 25 09:16:57 2013 -0700
Merge pull request #661 from mesos/streaming
[Kafka fixes and DStream.count fix for master]
1249e91 Mon Jun 24 21:46:33 2013 -0700
Merge pull request #572 from Reinvigorate/sm-block-interval
[Adding spark.streaming.blockInterval property]
cfcda95 Mon Jun 24 21:44:50 2013 -0700
Merge pull request #571 from Reinvigorate/sm-kafka-serializers
[Surfacing decoders on KafkaInputDStream]
575aff6 Mon Jun 24 21:35:50 2013 -0700
Merge pull request #567 from Reinvigorate/sm-count-fix
[Fixing count() in Spark Streaming]
3e61bef Sat Jun 22 16:22:47 2013 -0700
Merge pull request #648 from shivaram/netty-dbg
[Shuffle fixes and cleanup]
1ef5d0d Sat Jun 22 09:35:57 2013 -0700
Merge pull request #644 from shimingfei/joblogger
[add Joblogger to Spark (on new Spark code)]
7e4b266 Sat Jun 22 07:53:18 2013 -0700
Merge pull request #563 from jey/python-optimization
[Optimize PySpark worker invocation]
71030ba Wed Jun 19 15:21:03 2013 -0700
Merge pull request #654 from lyogavin/enhance_pipe
[fix typo and coding style in #638]
73f4c7d Tue Jun 18 04:21:17 2013 -0700
Merge pull request #605 from esjewett/SPARK-699
[Add hBase example (retry of pull request #596)]
9933836 Tue Jun 18 02:41:10 2013 -0700
Merge pull request #647 from jerryshao/master
[Reduce ZippedPartitionsRDD's getPreferredLocations complexity from O(2^2n) to O(2^n)]
db42451 Mon Jun 17 15:26:36 2013 -0700
Merge pull request #643 from adatao/master
[Bug fix: Zero-length partitions result in NaN for overall mean & variance]
e82a2ff Mon Jun 17 15:13:15 2013 -0700
Merge pull request #653 from rxin/logging
[SPARK-781: Log the temp directory path when Spark says "Failed to create temp directory."]
e6d1277 Mon Jun 17 12:56:25 2013 -0700
Merge pull request #638 from lyogavin/enhance_pipe
[Enhance pipe to support more features we can do in hadoop streaming]
f961aac Sat Jun 15 00:53:41 2013 -0700
Merge pull request #649 from ryanlecompte/master
[Add top K method to RDD using a bounded priority queue]
6602d94 Fri Jun 14 10:41:31 2013 -0700
Merge pull request #651 from rxin/groupbykey
[SPARK-772 / SPARK-774: groupByKey and cogroup should disable map side combine]
d93851a Thu Jun 13 13:38:45 2013 -0700
Merge pull request #645 from pwendell/compression
[Adding compression to Hadoop save functions]
f1da591 Wed Jun 12 17:55:08 2013 -0700
Merge pull request #646 from markhamstra/jvmArgs
[Fixed jvmArgs in maven build.]
0e94b73 Mon Jun 10 13:00:31 2013 -0700
Merge pull request #625 from stephenh/fix-start-slave
[Fix start-slave not passing instance number to spark-daemon.]
74b91d5 Sat Jun 8 01:19:40 2013 -0700
Merge pull request #629 from c0s/master
[Sometime Maven build runs out of PermGen space.]
c8fc423 Fri Jun 7 22:43:18 2013 -0700
Merge pull request #631 from jerryshao/master
[Fix block manager UI display issue when enable spark.cleaner.ttl]
1ae60bc Fri Jun 7 22:39:06 2013 -0700
Merge pull request #634 from xiajunluan/master
[[Spark-753] Fix ClusterSchedulSuite unit test failed ]
fff3728 Tue Jun 4 16:09:50 2013 -0700
Merge pull request #640 from pwendell/timeout-update
[Fixing bug in BlockManager timeout]
f420d4f Tue Jun 4 15:25:58 2013 -0700
Merge pull request #639 from pwendell/timeout-update
[Bump akka and blockmanager timeouts to 60 seconds]
84530ba Fri May 31 17:06:13 2013 -0700
Merge pull request #636 from rxin/unpersist
[Unpersist More block manager cleanup.]
ef77bb7 Thu May 30 14:50:06 2013 -0700
Merge pull request #627 from shivaram/master
[Netty and shuffle bug fixes]
8cb8178 Thu May 30 14:17:44 2013 -0700
Merge pull request #628 from shivaram/zero-block-size
[Skip fetching zero-sized blocks in NIO.]
6ed7139 Wed May 29 10:14:22 2013 -0700
Merge pull request #626 from stephenh/remove-add-if-no-port
[Remove unused addIfNoPort.]
41d230c Tue May 28 23:35:24 2013 -0700
Merge pull request #611 from squito/classloader
[Use default classloaders for akka & deserializing task results]
3db1e17 Mon May 27 21:31:43 2013 -0700
Merge pull request #620 from jerryshao/master
[Fix CheckpointRDD java.io.FileNotFoundException when calling getPreferredLocations]
3d4891d Sat May 25 23:38:05 2013 -0700
Merge pull request #621 from JoshRosen/spark-613
[Use ec2-metadata in start-slave.sh to detect if running on EC2]
e8d4b6c Sat May 25 21:09:03 2013 -0700
Merge pull request #529 from xiajunluan/master
[[SPARK-663]Implement Fair Scheduler in Spark Cluster Scheduler ]
9a3c344 Sat May 25 17:53:43 2013 -0700
Merge pull request #624 from rxin/master
[NonJavaSerializableClass should not be Java serializable...]
24e41aa Fri May 24 16:48:52 2013 -0700
Merge pull request #623 from rxin/master
[Automatically configure Netty port.]
69161f9 Fri May 24 14:42:13 2013 -0700
Merge pull request #622 from rxin/master
[bug fix: Shuffle block iterator is ignoring the shuffle serializer setting.]
dbbedfc Thu May 23 23:11:06 2013 -0700
Merge pull request #616 from jey/maven-netty-exclusion
[Exclude old versions of Netty from Maven-based build]
a2b0a79 Tue May 21 18:16:20 2013 -0700
Merge pull request #619 from woggling/adjust-sampling
[Use ARRAY_SAMPLE_SIZE constant instead of hard-coded 100.0 in SizeEstimator]
66dac44 Tue May 21 11:41:42 2013 -0700
Merge pull request #618 from woggling/dead-code-disttest
[DistributedSuite: remove dead code]
5912cc4 Fri May 17 19:58:40 2013 -0700
Merge pull request #610 from JoshRosen/spark-747
[Throw exception if TaskResult exceeds Akka frame size]
6c27c38 Thu May 16 17:33:56 2013 -0700
Merge pull request #615 from rxin/build-fix
[Maven build fix & two other small changes]
2f576ab Wed May 15 18:06:24 2013 -0700
Merge pull request #602 from rxin/shufflemerge
[Manual merge & cleanup of Shane's Shuffle Performance Optimization]
48c6f46 Wed May 15 10:47:19 2013 -0700
Merge pull request #612 from ash211/patch-4
[Docs: Mention spark shell's default for MASTER]
203d7b7 Wed May 15 00:47:20 2013 -0700
Merge pull request #593 from squito/driver_ui_link
[Master UI has link to Application UI]
016ac86 Mon May 13 21:45:36 2013 -0700
Merge pull request #601 from rxin/emptyrdd-master
[EmptyRDD (master branch 0.8)]
4b354e0 Mon May 13 17:39:19 2013 -0700
Merge pull request #589 from mridulm/master
[Add support for instance local scheduling]
5dbc9b2 Sun May 12 11:03:10 2013 -0700
Merge pull request #608 from pwendell/SPARK-738
[SPARK-738: Spark should detect and wrap nonserializable exceptions]
63e1999 Fri May 10 13:54:03 2013 -0700
Merge pull request #606 from markhamstra/foreachPartition_fix
[Actually use the cleaned closure in foreachPartition]
42bbe89 Wed May 8 22:30:31 2013 -0700
Merge pull request #599 from JoshRosen/spark-670
[Fix SPARK-670: EC2 'start' command should require -i option.]
0f1b7a0 Wed May 8 13:38:50 2013 -0700
Merge pull request #596 from esjewett/master
[hBase example]
7af92f2 Sat May 4 22:29:17 2013 -0700
Merge pull request #597 from JoshRosen/webui-fixes
[Two minor bug fixes for Spark Web UI]
c74ce60 Sat May 4 22:26:35 2013 -0700
Merge pull request #598 from rxin/blockmanager
[Fixed flaky unpersist test in DistributedSuite.]
3bf2c86 Fri May 3 18:27:30 2013 -0700
Merge pull request #594 from shivaram/master
[Add zip partitions to Java API]
2484ad7 Fri May 3 17:08:55 2013 -0700
Merge pull request #587 from rxin/blockmanager
[A set of shuffle map output related changes]
6fe9d4e Thu May 2 21:33:56 2013 -0700
Merge pull request #592 from woggling/localdir-fix
[Don't accept generated local directory names that can't be created]
538ee75 Thu May 2 09:01:42 2013 -0700
Merge pull request #581 from jerryshao/master
[fix [SPARK-740] block manage UI throws exception when enabling Spark Streaming]
9abcbcc Wed May 1 22:45:10 2013 -0700
Merge pull request #591 from rxin/removerdd
[RDD.unpersist: probably the most desired feature of Spark]
aa8fe1a Tue Apr 30 22:30:18 2013 -0700
Merge pull request #586 from mridulm/master
[Pull request to address issues Reynold Xin reported]
f708dda Tue Apr 30 07:51:40 2013 -0700
Merge pull request #585 from pwendell/listener-perf
[[Fix SPARK-742] Task Metrics should not employ per-record timing by default]
68c07ea Sun Apr 28 20:19:33 2013 -0700
Merge pull request #582 from shivaram/master
[Add zip partitions interface]
f6ee9a8 Sun Apr 28 15:36:04 2013 -0700
Merge pull request #583 from mridulm/master
[Fix issues with streaming test cases after yarn branch merge]
cf54b82 Thu Apr 25 11:45:58 2013 -0700
Merge pull request #580 from pwendell/quickstart
[SPARK-739 Have quickstart standlone job use README]
118a6c7 Wed Apr 24 08:42:30 2013 -0700
Merge pull request #575 from mridulm/master
[Manual merge of yarn branch to trunk]
5d8a71c Tue Apr 16 19:48:02 2013 -0700
Merge pull request #570 from jey/increase-codecache-size
[Increase ReservedCodeCacheSize for sbt]
ec5e553 Sun Apr 14 08:20:13 2013 -0700
Merge pull request #558 from ash211/patch-jackson-conflict
[Don't pull in old versions of Jackson via hadoop-core]
c1c219e Sun Apr 14 08:11:23 2013 -0700
Merge pull request #564 from maspotts/master
[Allow latest scala in PATH, with SCALA_HOME as override (instead of vice-versa)]
7c10b3e Fri Apr 12 20:55:22 2013 -0700
Merge pull request #565 from andyk/master
[Update wording of section on RDD operations in quick start guide in docs]
077ae0a Thu Apr 11 19:34:14 2013 -0700
Merge pull request #561 from ash211/patch-4
[Add details when BlockManager heartbeats time out]
c91ff8d Wed Apr 10 15:08:23 2013 -0700
Merge pull request #560 from ash211/patch-3
[Typos: cluser -> cluster]
7cd83bf Tue Apr 9 22:07:35 2013 -0700
Merge pull request #559 from ash211/patch-example-whitespace
[Uniform whitespace across scala examples]
271a4f3 Tue Apr 9 22:04:52 2013 -0700
Merge pull request #555 from holdenk/master
[Retry failed ssh commands in the ec2 python script.]
8ac9efb Tue Apr 9 13:50:50 2013 -0700
Merge pull request #527 from Reinvigorate/sm-kafka-cleanup
[KafkaInputDStream fixes and improvements]
eed54a2 Mon Apr 8 09:44:30 2013 -0700
Merge pull request #553 from pwendell/akka-standalone
[SPARK-724 - Have Akka logging enabled by default for standalone daemons]
b362df3 Sun Apr 7 17:17:52 2013 -0700
Merge pull request #552 from MLnick/master
[Bumping version for Twitter Algebird to latest]
4b30190 Sun Apr 7 17:15:10 2013 -0700
Merge pull request #554 from andyk/scala2.9.3
[Fixes SPARK-723 - Update build to Scala 2.9.3]
dfe98ca Tue Apr 2 19:24:12 2013 -0700
Merge pull request #550 from erikvanoosten/master
[corrected Algebird example]
b5d7830 Tue Apr 2 19:23:45 2013 -0700
Merge pull request #551 from jey/python-bugfixes
[Python bugfixes]
2be2295 Sun Mar 31 18:09:14 2013 -0700
Merge pull request #548 from markhamstra/getWritableClass_filter
[Fixed broken filter in getWritableClass[T]]
9831bc1 Fri Mar 29 22:16:22 2013 -0700
Merge pull request #539 from cgrothaus/fix-webui-workdirpath
[Bugfix: WorkerWebUI must respect workDirPath from Worker]
3cc8ab6 Fri Mar 29 22:14:07 2013 -0700
Merge pull request #541 from stephenh/shufflecoalesce
[Add a shuffle parameter to coalesce.]
cad507a Fri Mar 29 22:13:12 2013 -0700
Merge pull request #547 from jey/maven-streaming-tests-initialization-fix
[Move streaming test initialization into 'before' blocks]
a98996d Fri Mar 29 22:12:15 2013 -0700
Merge pull request #545 from ash211/patch-1
[Don't use deprecated Application in example]
104c694 Fri Mar 29 22:11:50 2013 -0700
Merge pull request #546 from ash211/patch-2
[Update tuning.md]
bc36ee4 Tue Mar 26 15:05:13 2013 -0700
Merge pull request #543 from holdenk/master
[Re-enable deprecation warnings and fix deprecated warning.]
b8949ca Sat Mar 23 07:19:34 2013 -0700
Merge pull request #505 from stephenh/volatile
[Make Executor fields volatile since they're read from the thread pool.]
fd53f2f Sat Mar 23 07:13:21 2013 -0700
Merge pull request #510 from markhamstra/WithThing
[mapWith, flatMapWith and filterWith]
4c5efcf Wed Mar 20 19:29:23 2013 -0700
Merge pull request #532 from andyk/master
[SPARK-715: Adds instructions for building with Maven to documentation]
3558849 Wed Mar 20 19:27:47 2013 -0700
Merge pull request #538 from rxin/cogroup
[Added mapSideCombine flag to CoGroupedRDD. Added unit test for CoGroupedRDD.]
ca4d083 Wed Mar 20 11:22:36 2013 -0700
Merge pull request #528 from MLnick/java-examples
[[SPARK-707] Adding Java versions of Pi, LogQuery and K-Means examples]
b812e6b Wed Mar 20 11:21:02 2013 -0700
Merge pull request #526 from markhamstra/foldByKey
[Add foldByKey]
945d1e7 Tue Mar 19 21:59:06 2013 -0700
Merge pull request #536 from sasurfer/master
[CoalescedRDD for many partitions]
1cbbe94 Tue Mar 19 21:34:34 2013 -0700
Merge pull request #534 from stephenh/removetrycatch
[Remove try/catch block that can't be hit.]
71e53f8 Tue Mar 19 21:31:41 2013 -0700
Merge pull request #537 from wishbear/configurableInputFormat
[call setConf from input format if it is Configurable]
c1e9cdc Sat Mar 16 11:47:45 2013 -0700
Merge pull request #525 from stephenh/subtractByKey
[Add PairRDDFunctions.subtractByKey.]
cdbfd1e Fri Mar 15 15:13:28 2013 -0700
Merge pull request #516 from squito/fix_local_metrics
[Fix local metrics]
f9fa2ad Fri Mar 15 15:12:43 2013 -0700
Merge pull request #530 from mbautin/master-update-log4j-and-make-compile-in-IntelliJ
[Add a log4j compile dependency to fix build in IntelliJ]
4032beb Wed Mar 13 19:29:46 2013 -0700
Merge pull request #521 from stephenh/earlyclose
[Close the reader in HadoopRDD as soon as iteration end.]
3c97276 Wed Mar 13 19:25:08 2013 -0700
Merge pull request #524 from andyk/master
[Fix broken link to YARN documentation]
1c3d981 Wed Mar 13 19:23:48 2013 -0700
Merge pull request #517 from Reinvigorate/sm-build-fixes
[Build fixes for streaming /w SBT]
2d477fd Wed Mar 13 06:49:16 2013 -0700
Merge pull request #523 from andyk/master
[Fix broken link in Quick Start]
00c4d23 Tue Mar 12 22:19:00 2013 -0700
Merge pull request #518 from woggling/long-bm-sizes
[Send block sizes as longs in BlockManager updates]
cbf8f0d Mon Mar 11 00:23:57 2013 -0700
Merge pull request #513 from MLnick/bagel-caching
[Adds choice of persistence level to Bagel.]
91a9d09 Sun Mar 10 15:48:23 2013 -0700
Merge pull request #512 from patelh/fix-kryo-serializer
[Fix reference bug in Kryo serializer, add test, update version]
557cfd0 Sun Mar 10 15:44:57 2013 -0700
Merge pull request #515 from woggling/deploy-app-death
[Notify standalone deploy client of application death.]
04fb81f Sun Mar 3 17:20:07 2013 -0800
Merge pull request #506 from rxin/spark-706
[Fixed SPARK-706: Failures in block manager put leads to read task hanging.]
6cf4be4 Sun Mar 3 17:16:22 2013 -0800
Merge pull request #462 from squito/stageInfo
[Track assorted metrics for each task, report summaries to user at stage completion]
6bfc7ca Sat Mar 2 22:14:49 2013 -0800
Merge pull request #504 from mosharaf/master
[Worker address was getting removed when removing an app.]
94b3db1 Sat Mar 2 22:13:52 2013 -0800
Merge pull request #508 from markhamstra/TestServerInUse
[Avoid bind failure in InputStreamsSuite]
25c71d3 Fri Mar 1 08:00:18 2013 -0800
Merge pull request #507 from markhamstra/poms271
[bump version to 0.7.1-SNAPSHOT in the subproject poms]