Google Git
Sign in
apache/gobblin/HEAD
  1. 26406a8 [GOBBLIN-2256]Optimize manifest discovery with paralleism (#4163) by pratapaditya04 · 29 hours ago master
  2. 90399ee [GOBBLIN-2255] Temporal workflow fast failure (#4174) by Gulbarga Adithya Rao · 7 days ago
  3. 452283e Orchestration Layer Issue Capturing (#4167) by Agam Pal Singh · 7 days ago
  4. b594188 [GOBBLIN-2254] Add timeout in gobblintaskrunner shutdown and move metrics reporting … (#4173) by Vivek Rai · 7 days ago
  5. f34dc82 add fsUri in dataset descriptor for iceberg source for lineage (#4172) by Vivek Rai · 8 days ago
  6. 4a041b8 added missing source and destinatin data required for lineage (#4170) by Vivek Rai · 12 days ago
  7. 1c875ce Skip Permission Check for files existing in target, (#4162) by Vyom Aggarwal · 12 days ago
  8. dcbe779 [GOBBLIN-2211] Use correct jobExecId when fetching jobStatus (#4169) by pratapaditya04 · 3 weeks ago
  9. 5e128c9 [GOBBLIN-2247] Add cleanup logic for Staging directories in temporal flow (#4166) by pratapaditya04 · 3 weeks ago
  10. 9e557b8 [GOBBLIN-2246] Make Orchestrator MDM metric dimesnion configurable (#4164) by Gulbarga Adithya Rao · 4 weeks ago
  11. d445b1e Update Jar cache directory partitioning bi-monthly from monthly (#4165) by Agam Pal Singh · 4 weeks ago
  12. fc24ec4 bumped docker testcontainers version (#4168) by Gulbarga Adithya Rao · 4 weeks ago
  13. 8e9146e [GOBBLIN-2245] Independent Dynamic Scaling for different Activities in Temporal WorkFlow (#4159) by Agam Pal Singh · 9 weeks ago
  14. 4ee5b3e [GOBBLIN-2243]Add Fallback dir for Jar caching (#4160) by pratapaditya04 · 3 months ago
  15. 6619cb1 Populate file set property in CopyableFile for IcebergFileStreamExtractor (#4161) by thisisArjit · 3 months ago
  16. 663929c [GOBBLIN-2209] Emit GaaS Executor Otel Metrics (#4118) by Vivek Rai · 3 months ago
  17. 85dbbc6 added cert based authentication in mysql gaas (#4158) by pratapaditya04 · 4 months ago
  18. a5a8935 attempt partial commit only in case commit policy is partial commit (#4157) by Vivek Rai · 4 months ago
  19. 7923a96 Add pre-publish step for IcebergSource and fix other issues in Iceberg file based copy (#4155) by thisisArjit · 4 months ago
  20. 00d0ab9 [GOBBLIN-2239] Introduce pushMessagesSync for sync GTE emission (#4156) by Vivek Rai · 4 months ago
  21. 9ad7ad2 [GOBBLIN-2231] Added extractor for partition-aware file copy from Iceberg to any dest (#4154) by Prateek Khandelwal · 4 months ago
  22. e98452a [GOBBLIN-2231] Implement IcebergSource to enable copying Iceberg data files to any dest (#4146) by Prateek Khandelwal · 4 months ago
  23. 93be76b [GOBBLIN-2238]Remove unsupported ChaCha20 cipher suites from default SSL configuration (#4153) by pratapaditya04 · 4 months ago
  24. 858f706 [GOBBLIN-2234] Fix removal of existing ACLs issue for path existing in destination (#4149) by abhishekmjain · 5 months ago
  25. c12e321 [GOBBLIN-2237]Make AvroUtils compatible with avro 1.10 (#4152) by pratapaditya04 · 5 months ago
  26. 8ba6c1f [GOBBLIN-2236] Remove dataset urn specific properties from CommitStats (#4151) by abhishekmjain · 5 months ago
  27. 7c54b95 Fix owner execute permission bit issue for path existing in destination (#4147) by abhishekmjain · 5 months ago
  28. 66e95ce Evolve iceberg table schema for partition copy (#4142) by thisisArjit · 5 months ago
  29. 179baac Emit job metrics at RM level (#4143) by thisisArjit · 5 months ago
  30. 20731d5 [GOBBLIN-2229] Enable access to Dataset state store during work discovery (#4144) by pratapaditya04 · 6 months ago
  31. 756c580 [GOBBLIN-2227] Make dag action and spec store monitor initialization config driven (#4141) by Vivek Rai · 6 months ago
  32. 5ad93db Construct iceberg data files during commit step (#4140) by thisisArjit · 6 months ago
  33. 3617c8f Revert "[GOBBLIN-2223] Optimise writing of serialised Work Unit to File syste…" (#4138) by thisisArjit · 7 months ago
  34. 6849776 [GOBBLIN-2225] Use random id for Workunit if recovery helper is not initialised (#4134) by thisisArjit · 7 months ago
  35. 88555c2 [GOBBLIN-2223] Optimise writing of serialised Work Unit to File system (#4133) by thisisArjit · 7 months ago
  36. 1ab8993 Remove unnecessary CopyEntity deserialisation (#4132) by thisisArjit · 7 months ago
  37. 877a0f8 Change data files from byte[] to list of base64 encoded string (#4131) by thisisArjit · 7 months ago
  38. f7fe367 DQ handling for no bytes read scenarios and metrics for bytes read/written (#4135) by vsinghal85 · 7 months ago
  39. 08272be [GOBBLIN-2218] Fix bug for executions failing with one-time schedule (#4130) by Suryakant Agarwal · 7 months ago
  40. 5c5db48 Emit metrics if dag act throws exception (#4129) by thisisArjit · 7 months ago
  41. 57d728a Update job status before adding REEVALUATE dag action (#4128) by thisisArjit · 7 months ago
  42. 8c67103 Evaluate data quality only when Policies are applied (#4127) by vsinghal85 · 7 months ago
  43. 26b3b77 Send flow event if flow deadline is crossed (#4126) by thisisArjit · 7 months ago
  44. 4c4d2ba [GOBBLIN-2204] Implement FileSize Data Quality for FileBasedCopy by vsinghal85 · 7 months ago
  45. 9151f93 Insert Final summary issue entry in issues table (#4125) by NamsB7 · 8 months ago
  46. ddd9468 Propagate file system job properties to Work units (#4124) by thisisArjit · 8 months ago
  47. 51773ab [GOBBLIN-2211] Implement Error Classification based on execution issues (#4121) by NamsB7 · 8 months ago
  48. c6e2112 Fix AvroCompactionTaskTest & OrcCompactionTaskTest (#4122) by thisisArjit · 8 months ago
  49. 5da75ce [GOBBLIN-2208] Acl preservation fix (#4117) by vsinghal85 · 10 months ago
  50. 1c6c24f [GOBBLIN-2207] Make temporal unique classifier GaaS attempt aware (#4116) by pratapaditya04 · 10 months ago
  51. 8d71c89 [GOBBLIN-2206] Revert extra execute bit getting set in ManifestDistcp (#4115) by Vivek Rai · 11 months ago
  52. be7c1a7 [GOBBLIN-2200] Onboard a new job executionId to deprecate Azkaban executionId (#4108) by pratapaditya04 · 11 months ago
  53. b535daf Add data quality field in GaaSJobObservabilityEventSchema (#4114) by vsinghal85 · 11 months ago
  54. 4cfa2f7 [GOBBLIN-2203] Add Support for Delete Manifests in Iceberg Full Table Replication (#4112) by Vivek Rai · 11 months ago
  55. 0548766 change aggregation temporality to DELTA instead of CUMULATIVE (#4111) by Vivek Rai · 11 months ago
  56. 4a4c171 Checkstyle fix (#4110) by vsinghal85 · 12 months ago
  57. 60a9d31 DagProcessingThread bug fix (#4109) by vsinghal85 · 12 months ago
  58. a978b29 [GOBBLIN-2199] Support dynamic container scaling based on target completion time & WU count (#4106) by Prateek Khandelwal · 1 year ago
  59. 8b250d4 [GOBBLIN-2147] Added lookback time fetch in partitioned filesource (#4044) by Vivek Rai · 1 year ago
  60. a37a241 Prevent dagProcessingEngine thread termination by handling exceptions gracefully (#4105) by Prateek Khandelwal · 1 year ago
  61. e64f707 [GOBBLIN-2190] Added param to create Activityoptions without HeartbeatTimeout (#4103) by Vivek Rai · 1 year, 1 month ago
  62. 1d93982 [GOBBLIN-2190] Added SUBMITGTE activity to ActivityType enum (#4102) by Vivek Rai · 1 year, 1 month ago
  63. f2bcdc7 [GOBBLIN-2190] Implement ActivityType & add HeartBeat for Temporal Activities (#4093) by Vivek Rai · 1 year, 1 month ago
  64. eb60a2c [GOBBLIN-2189] Implemented ContainerCompletion callback in DynamicScalingYarnService by Vivek Rai · 1 year, 1 month ago
  65. db9cf7e corrected log statement by Vivek Rai · 1 year, 1 month ago
  66. dee3fe4 added a comment by Vivek Rai · 1 year, 1 month ago
  67. 8dde23a Upgrade hadoop-azure-datalake dependency (#4099) by abhishekmjain · 1 year, 1 month ago
  68. 23c4481 [GOBBLIN-2194] Close temporal metrics scope on job completion (#4097) by abhishekmjain · 1 year, 1 month ago
  69. f341c1e addressed comments by Vivek Rai · 1 year, 1 month ago
  70. 861916a removed extra spaces by Vivek Rai · 1 year, 1 month ago
  71. 729bebb added test for non-replacement case by Vivek Rai · 1 year, 1 month ago
  72. 29891fd added test for handle container completion by Vivek Rai · 1 year, 1 month ago
  73. 4c7b019 fixed typo by Vivek Rai · 1 year, 1 month ago
  74. 90b7e6c addressed review comments by Vivek Rai · 1 year, 1 month ago
  75. adef734 Add metrics support for Temporal Workflow (#4095) by abhishekmjain · 1 year, 1 month ago
  76. 7a80eb7 addressed review comments by Vivek Rai · 1 year, 2 months ago
  77. 09a3e21 [GOBBLIN-2191] Shutdown GobblinJobLauncher executor (#4094) by abhishekmjain · 1 year, 2 months ago
  78. e69a77e improved dummy tests by Vivek Rai · 1 year, 2 months ago
  79. e584e5b [GOBBLIN-2182] Cleanup workdir in Gobblin-on-Temporal execution (#4085) by Vivek Rai · 1 year, 2 months ago
  80. 089e2e0 fix updating workforce plan while containerCompletion by Vivek Rai · 1 year, 2 months ago
  81. e8f7574 initial dynamicscalingyarnservice changes for handleContainerCompletion by Vivek Rai · 1 year, 2 months ago
  82. a0cef28 [GOBBLIN-2188] Define `Initializer.AfterInitializeMemento` for GoT to tunnel state from `GenerateWorkUnits` to `CommitActivity` (#4091) by Kip Kohn · 1 year, 2 months ago
  83. 87c8ab4 [GOBBLIN-2187] Prevent NaN while generating `WorkUnitsSizeSummary.Distillation` (#4090) by Vivek Rai · 1 year, 2 months ago
  84. 3269764 [GOBBLIN-2186] Emit GoT GTEs to time `WorkUnit` prep and to record volume of Work Discovery (#4089) by Kip Kohn · 1 year, 3 months ago
  85. 7dbeebf [GOBBLIN-2185] Recommend GoT Dynamic Auto-Scaling using heuristics based on `WorkUnitsSizeSummary` (#4087) by Kip Kohn · 1 year, 3 months ago
  86. faecb35 [GOBBLIN-2181] Ensure `DagTask::conclude` after a non-transient exception (#4084) by vsinghal85 · 1 year, 3 months ago
  87. 2595f6c [GOBBLIN-2177] Avoid shutting down QueueProcessor on non-InterruptedException (#4080) by abhishekmjain · 1 year, 3 months ago
  88. 0bf770c [GOBBLIN-2175] Support partial commit with Gobblin-on-Temporal execution (#4078) by pratapaditya04 · 1 year, 3 months ago
  89. f4728fb [GOBBLIN-2178] Remove (deprecated and unused) `GaaSObservabilityEventExperimental` (#4081) by Swapnil · 1 year, 3 months ago
  90. 003590e [GOBBLIN-2179] Enhance GoT observability with `WorkUnitsSizeSummary` and `WorkUnitSizeInfo` (#4082) by Kip Kohn · 1 year, 3 months ago
  91. 7309060 [GOBBLIN-2174] Define `DynamicScalingYarnService` for the GoT workforce via `ScalingDirective`s (#4077) by Vivek Rai · 1 year, 3 months ago
  92. 2142d22 [GOBBLIN-2176] Set default `java.net.Authenticator` in Temporal worker containers (#4079) by abhishekmjain · 1 year, 4 months ago
  93. e5d897e [GOBBLIN-2173] Disallow adhoc flows sharing the same FlowId within epsilon (#4076) by vsinghal85 · 1 year, 4 months ago
  94. 4e38b2f [GOBBLIN-2170] Define Gobblin-on-Temporal dynamic `ScalingDirective`s with parser and `FsScalingDirectiveSource` (#4068) by Kip Kohn · 1 year, 4 months ago
  95. 4bb0c40 [GOBBLIN-2172] Enable launching GoT YARN AM and workers with proxy HTTPS host+port (#4075) by abhishekmjain · 1 year, 4 months ago
  96. 13a6926 [GOBBLIN-2171] Streamline log messages for easier debugging of GaaS multi-active DAG processing (#4074) by Kip Kohn · 1 year, 4 months ago
  97. edaf474 [GOBBLIN-2169] avoid npe while overwrite if table has no previous snapshot (#4071) by Vivek Rai · 1 year, 5 months ago
  98. b4e4d4a [GOBBLIN-2163] Add Iceberg-Distcp table metadata validation (for partition copy) (#4064) by Vivek Rai · 1 year, 5 months ago
  99. 4b639f6 [GOBBLIN-2159] Support partition level copy in Iceberg-Distcp (#4058) by Vivek Rai · 1 year, 5 months ago
  100. 916d570 [GOBBLIN-2167] Allow filtering of Hive datasets by underlying HDFS folder location (#4069) by William Lo · 1 year, 5 months ago