Google Git
Sign in
apache / gobblin / HEAD
  1. c823e98 [GOBBLIN-2065] Increase `TestMetastoreDatabaseServer` concurrent cnxns; plus make closing `ITestMetastoreDatabase` `alwaysRun = true` and doc reason (#3948) by Kip Kohn · 17 hours ago master
  2. 8eeb743 close ITestMetastoreDatabase in all tests (#3946) by Arjun Singh Bora · 2 days ago
  3. c1a09f0 [GOBBLIN-2064] Use proper GSON builder class for GaaSObservabilityProducer and cleanup fully qualified classnames in tests (#3945) by William Lo · 2 days ago
  4. 7a11e72 Graduate GaaSObservabilityEventExperimental (#3940) by William Lo · 3 days ago
  5. 7d95f70 [GOBBLIN-2061] Fix initialization for DagProcessingEngine (#3943) by umustafi · 4 days ago
  6. 354c78d [GOBBLIN-2060] Change jobStatus opentelemetry metric to flowSucceeded to better reflect metric values (#3941) by William Lo · 8 days ago
  7. 33660f5 [GOBBLIN-2059] Send empty resource if no custom configs are specified (#3939) by William Lo · 10 days ago
  8. 4de95d6 [GOBBLIN-2055] Only sets opentelemetry to be built locally rather than global (#3936) by William Lo · 13 days ago
  9. 9b4989e [GOBBLIN-2040] Remove the assumption that value of ComparableWatermark has to be comparable (#3935) by Zihan Li · 2 weeks ago
  10. df9a0c1 [GOBBLIN-2053] Add header and fix prefix configs opentelemetry (#3933) by William Lo · 2 weeks ago
  11. 77f9d38 [GOBBLIN-2054] Fix `CommitActivityImpl` to succeed for `TaskState`s that did not originate with `CopySource` (#3934) by Kip Kohn · 2 weeks ago
  12. 773da76 [GOBBLIN-2050] Add settings to allow for full cleanup in GobblinYarnAppLauncher (#3931) by William Lo · 2 weeks ago
  13. a74d17a [GOBBLIN-2051] Rework `FlowLaunchHandler`, `DagActionStore`, and related classes for clarity (#3927) by Kip Kohn · 2 weeks ago
  14. 36cdf2b [GOBBLIN-2040] Abstract comparable watermark (#3919) by Zihan Li · 3 weeks ago
  15. 62f645c [GOBBLIN-2049] Configure Gobblin Distcp Writer to fail if setPermission fails (#3929) by umustafi · 3 weeks ago
  16. b57ecbc [GOBBLIN-2046] Generalize gobblin-on-temporal `ProcessWorkUnitImpl` logging not to presume `CopyEntity` (#3925) by Kip Kohn · 3 weeks ago
  17. c8db780 [GOBBLIN-2048] Integrate `AutomaticTroubleshooter` with gobblin-on-temporal `CommitActivityImpl` (#3928) by Kip Kohn · 3 weeks ago
  18. e79375a [GOBBLIN-2043] Set execute bit only for new folders in manifest distcp (#3922) by William Lo · 3 weeks ago
  19. cb5a215 [GOBBLIN-2045] Integrate `AutomaticTroubleshooter` with gobblin-on-temporal `GenerateWorkUnitsImpl` (#3924) by Kip Kohn · 3 weeks ago
  20. 99c5a76 [GOBBLIN-2044] Catch and log exceptions in HighLevelConsumer queue consumption (#3923) by umustafi · 3 weeks ago
  21. 1fc5fb0 [GOBBLIN-2042] Fix bug where flowgraph validation initialization was creating multip… (#3921) by William Lo · 4 weeks ago
  22. 97fc864 [GOBBLIN-2041] Fix NPE in `CopySource::getCopyEntityClass` (#3920) by Kip Kohn · 4 weeks ago
  23. 19d1620 [GOBBLIN-2039] Handle failure scenarios multileader compilation startup (#3918) by William Lo · 4 weeks ago
  24. 4610f89 GOBBLIN-2033 set unique writer output dir by appending taskAttemptId to writer output path (#3910) by rongshen · 4 weeks ago
  25. a25c839 [GOBBLIN-2038] Fix bug where monitor startup is never occurring (#3917) by William Lo · 4 weeks ago
  26. 698b351 [GOBBLIN-2032] Make log sink config optional (#3911) by William Lo · 5 weeks ago
  27. 1ca4944 [GOBBLIN-2037] Start DagActionMonitor functionality after its dependencies (#3916) by umustafi · 5 weeks ago
  28. c0fa22c [GOBBLIN-2008] use https in repositories.gradle (#3884) by PJ Fanning · 5 weeks ago
  29. 125d787 [GOBBLIN-2023] add kill dag proc (#3901) by Arjun Singh Bora · 5 weeks ago
  30. 5779338 [GOBBLIN-2026] Fail the dataset cleaner flow during any Exception (#3913) by Arpit Varshney · 5 weeks ago
  31. 3dffd9c [GOBBLIN-2036] Fix type error where string config is forced into boolean type (#3915) by William Lo · 5 weeks ago
  32. ceca1e5 [GOBBLIN-2022] add re-evaluate dag proc (#3896) by Arjun Singh Bora · 5 weeks ago
  33. 1fe2958 Explicitly bind SchedulerLeaseArbiter (#3914) by umustafi · 5 weeks ago
  34. fb85f07 [GOBBLIN-2030] Integrate AutoTroubleshooter with Temporal (#3908) by Matthew Ho · 6 weeks ago
  35. 595446d [GOBBLIN-2031] Fix empty message in event submitter in Temporal (#3907) by Matthew Ho · 6 weeks ago
  36. ae257ac [HOTFIX] catch exception when fail to compute the iceberg file metrics (#3909) by Zihan Li · 6 weeks ago
  37. 54f87cb [GOBBLIN-2029 ]Codestyle changes in DagProc and related classes (#3906) by Arjun Singh Bora · 6 weeks ago
  38. e2655cf [GOBBLIN-2019] Remove circular dependency & initialize multi-active execution related classes (#3899) by umustafi · 6 weeks ago
  39. 7ac0ce7 [GOBBLIN-2028] make DagManagementStateStore return job status (#3905) by Arjun Singh Bora · 6 weeks ago
  40. 2bc6f87 [GOBBLIN-2027] move DagActionStore, MultiActiveLeaseArbiter and their implementation/test classes from gobblin-runtime to gobblin-service (#3904) by Arjun Singh Bora · 6 weeks ago
  41. de50eaf [GOBBLIN-2024]Improve the performance of GobblinMCEWriter (#3902) by Zihan Li · 6 weeks ago
  42. ed66943 Add always false predicate (#3903) by William Lo · 6 weeks ago
  43. fbd4ee8 [GOBBLIN-2020] Fix number of failure scenarios and bugs in temporal workflows (#3900) by William Lo · 7 weeks ago
  44. 35145ed [GOBBLIN-2021] Add logging to see when directories have their permissions resynced to which perms for manifest distcp (#3897) by William Lo · 7 weeks ago
  45. 058d23d [GOBBLIN-2018] Add Opentelemetry metrics for GaaS observability (#3881) by William Lo · 7 weeks ago
  46. 8066dc4 Generalize LeaseArbiterDecorator for Execution & Scheduling (#3890) by umustafi · 7 weeks ago
  47. 207756d [GOBBLIN-2004] Helix-free yarn app launcher (#3891) by Matthew Ho · 8 weeks ago
  48. 2bdf7eb [GOBBLIN-2015] implement LaunchDagProc to handle new dag launches (#3893) by Arjun Singh Bora · 8 weeks ago
  49. 3a54961 [GOBBLIN-2014] Add Temporal metadata tags to temporal parent workflow for GaaS commu… (#3894) by William Lo · 8 weeks ago
  50. ef88a58 [GOBBLIN-2006] Adding an iterator for fetching dataset versions (#3883) by Arpit Varshney · 8 weeks ago
  51. 2217205 [GOBBLIN-2013] update guice initialization for 'DagProcEngine enabled' and related classes (#3892) by Arjun Singh Bora · 8 weeks ago
  52. 02eca4f [GOBBLIN-1910] Pr dag refactor stage 2 (#3858) by Arjun Singh Bora · 9 weeks ago
  53. f90b590 [GOBBLIN-2012] Fix bug where wuprocessingspec causes issues with jackson in temporal (#3889) by William Lo · 9 weeks ago
  54. fee5a0e [GOBBLIN-2010] Implement Distributed Data Movement (DDM) Gobblin-on-Temporal end-to-end workflow for arbitrary job config (#3886) by Kip Kohn · 10 weeks ago
  55. 1af723e [GOBBLIN-2009] Set perm and acl correctly (#3887) by Arjun Singh Bora · 10 weeks ago
  56. a78ee54 [GOBBLIN-2007] Implement Distributed Data Movement (DDM) Gobblin-on-Temporal `WorkUnit` generation (for arbitrary `Source`) (#3880) by Kip Kohn · 2 months ago
  57. bdbbfe1 [GOBBLIN-2005] Use correct root path when finding relative paths on destination side (#3882) by Arjun Singh Bora · 3 months ago
  58. 436cf26 [GOBBLIN-1919] Rework a few more elements of MR-related job exec for reuse in Temporal-based execution (#3879) by Kip Kohn · 3 months ago
  59. 492fea2 [GOBBLIN-2002] create MostlyInMemoryDagManagementStateStore to merge UserQuotaManage… (#3878) by Arjun Singh Bora · 3 months ago
  60. 64bdc70 [GOBBLIN-1996] Add ability for Yarn app to terminate on finishing of temporal flow (#3865) by Matthew Ho · 3 months ago
  61. 75d9336 [GOBBLIN-2001] Add configuration to disable task failed event from emitting (#3877) by William Lo · 3 months ago
  62. 0e324d0 [GOBBLIN-1994] Fix iceberg-distcp dest-side `TableMetadata` consistency check to accurately detect "stale table metadata" (#3876) by Kip Kohn · 3 months ago
  63. deab0ce [GOBBLIN-2000] Add logging for concurrent flow status check (#3875) by William Lo · 3 months ago
  64. aec3401 [GOBBLIN-1998] Add Gobblin-temporal to gobblin-all (#3873) by Matthew Ho · 3 months ago
  65. 3e57562 [GOBBLIN-1999] Ignore concurrent check if the flow execution ID is the same as the c… (#3874) by William Lo · 3 months ago
  66. f6f1bc5 [GOBBLIN-1994] Ensure iceberg-distcp consistency by using same `TableMetadata` for both WU planning and final commit (#3870) by Kip Kohn · 3 months ago
  67. 96e7b16 [GOBBLIN-1989] TemporaI: Implementation of GTE for GaaS Observability Event in MR alternative for distcp (#3843) by Matthew Ho · 3 months ago
  68. 5e07cc7 [GOBBLIN-1997] Avoid deleting flowSpec too early (#3872) by umustafi · 3 months ago
  69. 67c6101 [GOBBLIN-1992] Propagate slf4j MDC Context in workflows and activities of the tempor… (#3868) by William Lo · 3 months ago
  70. 3061c70 Add config for excluding 'manifest.json' in iceberg-distcp data movement (#3869) by Kip Kohn · 3 months ago
  71. 24894f5 [GOBBLIN-1990] Update GobblinServiceManagerTest to reduce flakiness (#3864) by umustafi · 3 months ago
  72. 389c158 [GOBBLIN-1991] set (target) dataset path correctly in RecursiveCopyableDataset (#3867) by Arjun Singh Bora · 4 months ago
  73. 42f1be5 [GOBBLIN-1987] Allow run-immediately flows to execute in multi-active scheduler mode (#3861) by umustafi · 4 months ago
  74. 3a5cd53 [GOBBLIN-1988] Fail the streaming container when OOM issue happens (#3862) by Zihan Li · 4 months ago
  75. 318c661 [GOBBLIN-1910] part one of the changes that dag refactoring will require (#3853) by Arjun Singh Bora · 4 months ago
  76. f95b36f [GOBBLIN-1986] Log `FileStatus` for only the first N inputs in `GobblinWorkUnitsInputFormat` (#3860) by Kip Kohn · 4 months ago
  77. 913d580 [GOBBLIN-1984] Add consensus flowExecutionId to FlowSpec to use for compilation (#3857) by umustafi · 4 months ago
  78. be60021 Incorporate the mod time of enclosing dirs into the `SourceHadoopFsEndPoint.getWatermark` (#3859) by Kip Kohn · 4 months ago
  79. be12fd0 [GOBBLIN-1983] Remove Optionals to make DagManager, EventSubmitter, and TopologyCatalog required for GaaS operation (#3855) by Arjun Singh Bora · 4 months ago
  80. 22248e4 [GOBBLIN-1982] Show a consistent flowExecutionId btwn Compilation & Execution (#3854) by umustafi · 4 months ago
  81. f8880ed [GOBBLIN-1947] Send workUnitChange event when helix task consistently fail (#3832) by Hanghang Nate Liu · 4 months ago
  82. 39ffa2f Renames writer.path.type config name as it has a type conflict with writer.path (#3852) by William Lo · 4 months ago
  83. 3302569 [GOBBLIN-1979] Pare down `TaskStateCollectorService` failure logging, to avoid flooding logs during widespread failure, e.g. O(1k)+ (#3850) by Kip Kohn · 5 months ago
  84. e392c97 [GOBBLIN-1978] Initialize dag action store monitor metrics (#3851) by umustafi · 5 months ago
  85. 18fba9e [GOBBLIN-1968] Temporal commit step integration (#3829) by William Lo · 5 months ago
  86. cb36e2c Log when `PasswordManager` fails to load any master password (#3849) by Kip Kohn · 5 months ago
  87. 81910bf [GOBBLIN-1976] Allow an `IcebergCatalog` to override the `DatasetDescriptor` platform name for the `IcebergTable`s it creates (#3848) by Kip Kohn · 5 months ago
  88. 6371f06 [GOBBLIN-1973] Change Manifest distcp logic to compare permissions of source and dest files even when source is older (#3845) by William Lo · 5 months ago
  89. be34e9e [GOBBLIN-1974] Ensure Adhoc Flows can be Executed in Multi-active Scheduler state (#3846) by umustafi · 5 months ago
  90. 99a1aae [GOBBLIN-1975] Keep job.name configuration immutable if specified on GaaS (#3847) by William Lo · 5 months ago
  91. 00c60ca [GOBBLIN-1972] Fix `CopyDataPublisher` to avoid committing post-publish WUs before they've actually run (#3844) by Kip Kohn · 5 months ago
  92. a4ba9d3 [GOBBLIN-1970] Consolidate processing dag actions to one code path (#3841) by umustafi · 5 months ago
  93. bc456b9 [GOBBLIN-1971] Allow `IcebergCatalog` to specify the `DatasetDescriptor` name for the `IcebergTable`s it creates (#3842) by Kip Kohn · 5 months ago
  94. 694ed37 [GOBBLIN-1967] Add external data node for generic ingress/egress on GaaS (#3838) by William Lo · 5 months ago
  95. bbbfe3b [GOBBLIN-1960] Emit audit count after commit in IcebergMetadataWriter (#3833) by Matthew Ho · 5 months ago
  96. a292460 Delete Launch Action Events After Processing (#3837) by umustafi · 5 months ago
  97. 35304e9 Prevent NPE in `FlowCompilationValidationHelper.validateAndHandleConcurrentExecution` (#3836) by Kip Kohn · 6 months ago
  98. 97e8459 [GOBBLIN-1961] Allow `IcebergDatasetFinder` to use separate names for source vs. destination-side DB and table (#3835) by Kip Kohn · 6 months ago
  99. 9a6508e Use DB-qualified table ID as `IcebergTable` dataset descriptor (#3834) by Kip Kohn · 6 months ago
  100. 8b89075 [GOBBLIN-1957] GobblinOrcwriter improvements for large records (#3828) by William Lo · 6 months ago