Sign in
apache
/
incubator-retired-amaterasu
/
HEAD
« Previous
c474d54
fixed merge
by Yaniv Rodenski
· 5 years ago
c66e98d
removed platform specific command resolution
by Nadav Har Tzvi
· 5 years ago
812d36a
python path is configurable now
by Nadav Har Tzvi
· 5 years ago
09a8393
added support for basic python and pandas, pandas not fully integrated.
by Nadav Har Tzvi
· 5 years ago
075b73a
merged and tested on yarn
by Yaniv Rodenski
· 5 years ago
aff8b49
This actually caused the total destruction of any previously defined user resources
by Nadav Har Tzvi
· 5 years ago
b873978
resulves local executable on mesos
by Yaniv Rodenski
· 5 years ago
398b1b9
yarn is integrated
by Yaniv Rodenski
· 5 years ago
54cdcb3
refatored the action executable to its own function
by Yaniv Rodenski
· 5 years ago
bd9bab8
add file download from S3 bucket
by Yariv Triffon
· 5 years ago
6992ebf
Merge pull request #48 from roadan/AMATERASU-62
by Yaniv Rodenski
· 5 years ago
eee9347
fixed build
by Yaniv Rodenski
· 5 years ago
2b21705
created file util
by Yaniv Rodenski
· 5 years ago
08df7db
commented python files
by Yaniv Rodenski
· 5 years ago
b62775c
commented python files
by Yaniv Rodenski
· 5 years ago
c7cdc40
fixed tests
by Yaniv Rodenski
· 5 years ago
c9c62c8
removed commented files
by Yaniv Rodenski
· 5 years ago
e00e06a
fixed jar execution
by Yaniv Rodenski
· 5 years ago
d13ec9a
notifications are fixed
by Yaniv Rodenski
· 5 years ago
1493c84
removed appMaster consumer
by Yaniv Rodenski
· 5 years ago
8b46f75
fixed dist barier
by Yaniv Rodenski
· 5 years ago
cc85424
fixed yarn spark_home
by Yaniv Rodenski
· 5 years ago
36ee61a
fixed yarn spark_home
by Yaniv Rodenski
· 5 years ago
aa47f5e
update hadoop version
by Yaniv Rodenski
· 5 years ago
e14a4cf
framework resources are copied as folder
by Yaniv Rodenski
· 5 years ago
9be621f
making dist available on appMaster
by Yaniv Rodenski
· 5 years ago
41421f5
making dist available on appMaster
by Yaniv Rodenski
· 5 years ago
f3d430f
added loading of spark env
by Yaniv Rodenski
· 5 years ago
ff5f1fa
checking registered actions
by Yaniv Rodenski
· 5 years ago
ef483e9
added support for pandas, fixed support for basic python
by Nadav Har Tzvi
· 5 years ago
0592eac
jobManager fixes
by Yaniv Rodenski
· 5 years ago
d7c16ca
jobManager fixes
by Yaniv Rodenski
· 5 years ago
29a6f87
fixed job state
by Yaniv Rodenski
· 5 years ago
d2d0c12
fixed new-job-id
by Yaniv Rodenski
· 5 years ago
89ebd0d
fixed new-job-id
by Yaniv Rodenski
· 5 years ago
d5e4e3a
fixed appmaster cli args
by Yaniv Rodenski
· 5 years ago
1441e6f
debugging appmaster command
by Yaniv Rodenski
· 5 years ago
75d3ef5
better null handling for spark
by Yaniv Rodenski
· 5 years ago
85814bf
removed try initjob
by Yaniv Rodenski
· 5 years ago
29e7be4
checking for spark-exec-env
by Yaniv Rodenski
· 5 years ago
11ecb94
added zk path debug message
by Yaniv Rodenski
· 5 years ago
ae7bcc6
fixed jeckson version
by Yaniv Rodenski
· 5 years ago
85287a6
support for spark 2.4.0
by Yaniv Rodenski
· 5 years ago
dfde0f5
dependencies can be null
by Yaniv Rodenski
· 5 years ago
2b7b394
changed spark exec config to lazy
by Yaniv Rodenski
· 5 years ago
4bcc33b
moved data loader to kotlin
by Yaniv Rodenski
· 5 years ago
6a0f901
change spark configuration initilization
by Yaniv Rodenski
· 5 years ago
f16ebf8
added loging for emr
by Yaniv Rodenski
· 5 years ago
11d277e
spark obs are being lunched
by Yaniv Rodenski
· 5 years ago
8b4c35c
yarm containers resources are using the new SDK API
by Yaniv Rodenski
· 5 years ago
44695de
pyspark works. Started basic python runner.
by Nadav Har Tzvi
· 5 years ago
e285995
still trying to acknoledge task from within the executor
by Nadav Har Tzvi
· 5 years ago
114ebba
still trying to acknoledge task from within the executor
by Nadav Har Tzvi
· 5 years ago
3fdcc18
still trying to acknoledge task from within the executor
by Nadav Har Tzvi
· 5 years ago
d1ecc46
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
c3717f3
still trying to acknoledge task from within the executor
by Nadav Har Tzvi
· 5 years ago
c12a270
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
87614be
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
fb73685
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
283bf62
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
8cce4c1
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
7ad4428
still figuring out what's going on
by Nadav Har Tzvi
· 5 years ago
9fdd3b4
duh2
by Nadav Har Tzvi
· 5 years ago
e6e1fcd
duh
by Nadav Har Tzvi
· 5 years ago
374ba97
trying to notify the master that the task finished successfully
by Nadav Har Tzvi
· 5 years ago
ece1ee2
trying to notify the master that the task finished successfully
by Nadav Har Tzvi
· 5 years ago
b1ec3c1
pyspark works but the executors terminates for no apparent reason
by Nadav Har Tzvi
· 5 years ago
a98a45b
trying to get worker to use the correct python executable
by Nadav Har Tzvi
· 5 years ago
e5ea38f
trying to get worker to use the correct python executable
by Nadav Har Tzvi
· 5 years ago
ab4b636
trying to get worker to use the correct python executable
by Nadav Har Tzvi
· 5 years ago
717c488
trying to get worker to use the correct python executable
by Nadav Har Tzvi
· 5 years ago
8e12f48
trying to get worker to use the correct python executable
by Nadav Har Tzvi
· 5 years ago
88309c3
set pyspark_python
by Nadav Har Tzvi
· 5 years ago
79e06ea
set pyspark_python
by Nadav Har Tzvi
· 5 years ago
bd0044c
set pyspark_python
by Nadav Har Tzvi
· 5 years ago
a92abeb
env not loaded correctly
by Nadav Har Tzvi
· 5 years ago
9ced5d5
env not loaded correctly
by Nadav Har Tzvi
· 5 years ago
f60183e
env not loaded correctly
by Nadav Har Tzvi
· 5 years ago
36fe1bd
env not loaded correctly
by Nadav Har Tzvi
· 5 years ago
8f0bc6d
wrong name from leader
by Nadav Har Tzvi
· 5 years ago
3dd3571
default conf refitted to use default conf files form leader
by Nadav Har Tzvi
· 5 years ago
f810191
default conf refitted to use default conf files form leader
by Nadav Har Tzvi
· 5 years ago
f917f05
default conf refitted to use default conf files form leader
by Nadav Har Tzvi
· 5 years ago
148cad9
when working through spark-submit, unless something changed, can use the default sparkcontext and session
by Nadav Har Tzvi
· 5 years ago
2acc932
removed obsolete code
by Nadav Har Tzvi
· 5 years ago
8a3bc98
removed obsolete code
by Nadav Har Tzvi
· 5 years ago
7d180d0
still some issues with resolution of dependencies
by Nadav Har Tzvi
· 5 years ago
c96fe83
in case where the runtime isn't completely isolated (e.g. - mesos native containers), the python dependencies could end up not updating in case of a python sdk or spark update.
by Nadav Har Tzvi
· 5 years ago
be8dbf9
typo
by Nadav Har Tzvi
· 5 years ago
292a321
added stubs for spark
by Nadav Har Tzvi
· 5 years ago
346fe82
builder architecture
by Nadav Har Tzvi
· 5 years ago
51b004e
incorrect path in command
by Nadav Har Tzvi
· 5 years ago
da458e8
incorrect path passed to container
by Nadav Har Tzvi
· 5 years ago
1e19ccf
need to overwrite, otherwise it fails on retry
by Nadav Har Tzvi
· 5 years ago
c09a303
copy action source file to container
by Nadav Har Tzvi
· 5 years ago
acdadb6
Merge pull request #47 from anonymousGiraffe/refactoring-JobParser
by Yaniv Rodenski
· 5 years ago
0cdf280
Update JobManager.kt
by Yaniv Rodenski
· 5 years ago
1dce629
Update JobManager.kt
by Yaniv Rodenski
· 5 years ago
1395f3f
Merge branch 'master' into refactoring-JobParser
by guy peleg
· 5 years ago
8b79a28
making the variable private
by guy.peleg
· 5 years ago
Next »