Google Git
Sign in
apache / gobblin / HEAD
  1. 5ad93db Construct iceberg data files during commit step (#4140) by thisisArjit · 26 hours ago master
  2. 3617c8f Revert "[GOBBLIN-2223] Optimise writing of serialised Work Unit to File syste…" (#4138) by thisisArjit · 5 days ago
  3. 6849776 [GOBBLIN-2225] Use random id for Workunit if recovery helper is not initialised (#4134) by thisisArjit · 6 days ago
  4. 88555c2 [GOBBLIN-2223] Optimise writing of serialised Work Unit to File system (#4133) by thisisArjit · 7 days ago
  5. 1ab8993 Remove unnecessary CopyEntity deserialisation (#4132) by thisisArjit · 13 days ago
  6. 877a0f8 Change data files from byte[] to list of base64 encoded string (#4131) by thisisArjit · 14 days ago
  7. f7fe367 DQ handling for no bytes read scenarios and metrics for bytes read/written (#4135) by vsinghal85 · 2 weeks ago
  8. 08272be [GOBBLIN-2218] Fix bug for executions failing with one-time schedule (#4130) by Suryakant Agarwal · 4 weeks ago
  9. 5c5db48 Emit metrics if dag act throws exception (#4129) by thisisArjit · 4 weeks ago
  10. 57d728a Update job status before adding REEVALUATE dag action (#4128) by thisisArjit · 4 weeks ago
  11. 8c67103 Evaluate data quality only when Policies are applied (#4127) by vsinghal85 · 5 weeks ago
  12. 26b3b77 Send flow event if flow deadline is crossed (#4126) by thisisArjit · 5 weeks ago
  13. 4c4d2ba [GOBBLIN-2204] Implement FileSize Data Quality for FileBasedCopy by vsinghal85 · 5 weeks ago
  14. 9151f93 Insert Final summary issue entry in issues table (#4125) by NamsB7 · 6 weeks ago
  15. ddd9468 Propagate file system job properties to Work units (#4124) by thisisArjit · 6 weeks ago
  16. 51773ab [GOBBLIN-2211] Implement Error Classification based on execution issues (#4121) by NamsB7 · 7 weeks ago
  17. c6e2112 Fix AvroCompactionTaskTest & OrcCompactionTaskTest (#4122) by thisisArjit · 8 weeks ago
  18. 5da75ce [GOBBLIN-2208] Acl preservation fix (#4117) by vsinghal85 · 4 months ago
  19. 1c6c24f [GOBBLIN-2207] Make temporal unique classifier GaaS attempt aware (#4116) by pratapaditya04 · 4 months ago
  20. 8d71c89 [GOBBLIN-2206] Revert extra execute bit getting set in ManifestDistcp (#4115) by Vivek Rai · 4 months ago
  21. be7c1a7 [GOBBLIN-2200] Onboard a new job executionId to deprecate Azkaban executionId (#4108) by pratapaditya04 · 5 months ago
  22. b535daf Add data quality field in GaaSJobObservabilityEventSchema (#4114) by vsinghal85 · 5 months ago
  23. 4cfa2f7 [GOBBLIN-2203] Add Support for Delete Manifests in Iceberg Full Table Replication (#4112) by Vivek Rai · 5 months ago
  24. 0548766 change aggregation temporality to DELTA instead of CUMULATIVE (#4111) by Vivek Rai · 5 months ago
  25. 4a4c171 Checkstyle fix (#4110) by vsinghal85 · 5 months ago
  26. 60a9d31 DagProcessingThread bug fix (#4109) by vsinghal85 · 5 months ago
  27. a978b29 [GOBBLIN-2199] Support dynamic container scaling based on target completion time & WU count (#4106) by Prateek Khandelwal · 6 months ago
  28. 8b250d4 [GOBBLIN-2147] Added lookback time fetch in partitioned filesource (#4044) by Vivek Rai · 6 months ago
  29. a37a241 Prevent dagProcessingEngine thread termination by handling exceptions gracefully (#4105) by Prateek Khandelwal · 6 months ago
  30. e64f707 [GOBBLIN-2190] Added param to create Activityoptions without HeartbeatTimeout (#4103) by Vivek Rai · 6 months ago
  31. 1d93982 [GOBBLIN-2190] Added SUBMITGTE activity to ActivityType enum (#4102) by Vivek Rai · 7 months ago
  32. f2bcdc7 [GOBBLIN-2190] Implement ActivityType & add HeartBeat for Temporal Activities (#4093) by Vivek Rai · 7 months ago
  33. eb60a2c [GOBBLIN-2189] Implemented ContainerCompletion callback in DynamicScalingYarnService by Vivek Rai · 7 months ago
  34. db9cf7e corrected log statement by Vivek Rai · 7 months ago
  35. dee3fe4 added a comment by Vivek Rai · 7 months ago
  36. 8dde23a Upgrade hadoop-azure-datalake dependency (#4099) by abhishekmjain · 7 months ago
  37. 23c4481 [GOBBLIN-2194] Close temporal metrics scope on job completion (#4097) by abhishekmjain · 7 months ago
  38. f341c1e addressed comments by Vivek Rai · 7 months ago
  39. 861916a removed extra spaces by Vivek Rai · 7 months ago
  40. 729bebb added test for non-replacement case by Vivek Rai · 7 months ago
  41. 29891fd added test for handle container completion by Vivek Rai · 7 months ago
  42. 4c7b019 fixed typo by Vivek Rai · 7 months ago
  43. 90b7e6c addressed review comments by Vivek Rai · 7 months ago
  44. adef734 Add metrics support for Temporal Workflow (#4095) by abhishekmjain · 7 months ago
  45. 7a80eb7 addressed review comments by Vivek Rai · 7 months ago
  46. 09a3e21 [GOBBLIN-2191] Shutdown GobblinJobLauncher executor (#4094) by abhishekmjain · 7 months ago
  47. e69a77e improved dummy tests by Vivek Rai · 8 months ago
  48. e584e5b [GOBBLIN-2182] Cleanup workdir in Gobblin-on-Temporal execution (#4085) by Vivek Rai · 8 months ago
  49. 089e2e0 fix updating workforce plan while containerCompletion by Vivek Rai · 8 months ago
  50. e8f7574 initial dynamicscalingyarnservice changes for handleContainerCompletion by Vivek Rai · 8 months ago
  51. a0cef28 [GOBBLIN-2188] Define `Initializer.AfterInitializeMemento` for GoT to tunnel state from `GenerateWorkUnits` to `CommitActivity` (#4091) by Kip Kohn · 8 months ago
  52. 87c8ab4 [GOBBLIN-2187] Prevent NaN while generating `WorkUnitsSizeSummary.Distillation` (#4090) by Vivek Rai · 8 months ago
  53. 3269764 [GOBBLIN-2186] Emit GoT GTEs to time `WorkUnit` prep and to record volume of Work Discovery (#4089) by Kip Kohn · 8 months ago
  54. 7dbeebf [GOBBLIN-2185] Recommend GoT Dynamic Auto-Scaling using heuristics based on `WorkUnitsSizeSummary` (#4087) by Kip Kohn · 9 months ago
  55. faecb35 [GOBBLIN-2181] Ensure `DagTask::conclude` after a non-transient exception (#4084) by vsinghal85 · 9 months ago
  56. 2595f6c [GOBBLIN-2177] Avoid shutting down QueueProcessor on non-InterruptedException (#4080) by abhishekmjain · 9 months ago
  57. 0bf770c [GOBBLIN-2175] Support partial commit with Gobblin-on-Temporal execution (#4078) by pratapaditya04 · 9 months ago
  58. f4728fb [GOBBLIN-2178] Remove (deprecated and unused) `GaaSObservabilityEventExperimental` (#4081) by Swapnil · 9 months ago
  59. 003590e [GOBBLIN-2179] Enhance GoT observability with `WorkUnitsSizeSummary` and `WorkUnitSizeInfo` (#4082) by Kip Kohn · 9 months ago
  60. 7309060 [GOBBLIN-2174] Define `DynamicScalingYarnService` for the GoT workforce via `ScalingDirective`s (#4077) by Vivek Rai · 9 months ago
  61. 2142d22 [GOBBLIN-2176] Set default `java.net.Authenticator` in Temporal worker containers (#4079) by abhishekmjain · 9 months ago
  62. e5d897e [GOBBLIN-2173] Disallow adhoc flows sharing the same FlowId within epsilon (#4076) by vsinghal85 · 10 months ago
  63. 4e38b2f [GOBBLIN-2170] Define Gobblin-on-Temporal dynamic `ScalingDirective`s with parser and `FsScalingDirectiveSource` (#4068) by Kip Kohn · 10 months ago
  64. 4bb0c40 [GOBBLIN-2172] Enable launching GoT YARN AM and workers with proxy HTTPS host+port (#4075) by abhishekmjain · 10 months ago
  65. 13a6926 [GOBBLIN-2171] Streamline log messages for easier debugging of GaaS multi-active DAG processing (#4074) by Kip Kohn · 10 months ago
  66. edaf474 [GOBBLIN-2169] avoid npe while overwrite if table has no previous snapshot (#4071) by Vivek Rai · 10 months ago
  67. b4e4d4a [GOBBLIN-2163] Add Iceberg-Distcp table metadata validation (for partition copy) (#4064) by Vivek Rai · 11 months ago
  68. 4b639f6 [GOBBLIN-2159] Support partition level copy in Iceberg-Distcp (#4058) by Vivek Rai · 11 months ago
  69. 916d570 [GOBBLIN-2167] Allow filtering of Hive datasets by underlying HDFS folder location (#4069) by William Lo · 11 months ago
  70. e3baf91 [GOBBLIN-2166] Add azkaban exec props for GoT jobs as RMAppSummaryEvent app. tags (#4067) by abhishekmjain · 11 months ago
  71. 4f60423 [GOBBLIN-2162] Only load added jars in the cache (#4062) by William Lo · 11 months ago
  72. 2afab69 [GOBBLIN-2165] Support partial commit semantic from CopyDataPublisher (#4066) by William Lo · 11 months ago
  73. d4c9c35 Add default value for OpenTelemetry attribute (#4065) by Prateek Khandelwal · 11 months ago
  74. 20c4341 [GOBBLIN-2148] Add temporal workflow cancel support (#4045) by abhishekmjain · 11 months ago
  75. 4776135 [GOBBLIN-2161] Read logExporter classname from config property (#4063) by Prateek Khandelwal · 11 months ago
  76. 2bc5638 [GOBBLIN-2161] Support for configuring openTelemetry metric exporter as logExporter (#4061) by Prateek Khandelwal · 11 months ago
  77. 4fa6c51 [GOBBLIN-2157] Copy table properties in iceberg distcp (#4056) by William Lo · 12 months ago
  78. a07a4f1 [GOBBLIN-2135] Cache Gobblin YARN application jars (#4030) by William Lo · 12 months ago
  79. 8a8d230 [GOBBLIN-2153] Added search attributes to Temporal workflows (#4052) by pratapaditya04 · 12 months ago
  80. 72306bb [GOBBLIN-2156] log error after each failed AzkabanClient retry (#4055) by Arjun Singh Bora · 12 months ago
  81. c3d16b2 [GOBBLIN-2155] Fix bug where empty delete activity result was not jackson deserializ… (#4054) by William Lo · 12 months ago
  82. 35a4d8e bring back the old toString method for DagId (#4053) by Arjun Singh Bora · 12 months ago
  83. f9b80ac [GOBBLIN-2151] ignore flows that are running beyond job start and flow finish deadline when doing the concurrency check (#4050) by Arjun Singh Bora · 12 months ago
  84. f6eeb53 [GOBBLIN-2152] Cleanup activity gobblin temporal (#4047) by William Lo · 12 months ago
  85. 833fed3 [GOBBLIN-2136] consolidate various resource handlers for flowconfigs (#4041) by Arjun Singh Bora · 12 months ago
  86. f839130 fixing an issue of not able to connect to db (#4051) by Arjun Singh Bora · 12 months ago
  87. 45ad13e [GOBBLIN-2136] Byebye dag manager (#4031) by Arjun Singh Bora · 1 year ago
  88. f40bb44 [GOBBLIN-2150] calculate flow status correctly (#4048) by Arjun Singh Bora · 1 year ago
  89. 0ea2414 [GOBBLIN-2149] Add logs in OpenTelemetry for debugging (#4046) by abhishekmjain · 1 year ago
  90. 2695699 [GOBBLIN-2143] handle concurrent ReevaluateDagProc for cancelled dag nodes correctly (#4038) by Arjun Singh Bora · 1 year ago
  91. f6ba473 [GOBBLIN-2145] fix bug in getting flow status (#4040) by Arjun Singh Bora · 1 year ago
  92. 444f266 [GOBBLIN-2144] Prevent `GenerateWorkUnitsImpl` from inadvertently cleaning up temp/staging dirs (#4039) by Kip Kohn · 1 year ago
  93. b28b468 [GOBBLIN-2142] fix bug in determining if a dag is finished or not (#4037) by Arjun Singh Bora · 1 year ago
  94. 7c8127c [GOBBLIN-2141] Simulate directly on trash class (#4036) by William Lo · 1 year, 1 month ago
  95. d58bbc0 use a newer api in guava (#4034) by Arjun Singh Bora · 1 year, 1 month ago
  96. a214282 [GOBBLIN-2131] process all dag actions during startup parallely (#4024) by pratapaditya04 · 1 year, 1 month ago
  97. e857c00 [GOBBLIN-2133] provide job future before calling SpecProducer::cancelJob (#4027) by Arjun Singh Bora · 1 year, 1 month ago
  98. ac5d6ee [GOBBLIN-2132] set flow event field in dag and also emit GTE when flow is submitted (#4026) by Arjun Singh Bora · 1 year, 1 month ago
  99. 0542794 [GOBBLIN-2129] avoid throwing unnessary exception that is polluting logs (#4023) by Arjun Singh Bora · 1 year, 1 month ago
  100. bdbf43a [GOBBLIN-2130] avoid race condition b/w add dag node and delete dag (#4021) by Arjun Singh Bora · 1 year, 1 month ago