tree: 3dd911da96a5a85cd9ba55d55aa1ab073daea38f [path history] [tgz]
  1. rfc-27/
  2. rfc-34/
  3. rfc-37/
  4. rfc-38/
  5. rfc-39/
  6. rfc-40/
  7. rfc-41/
  8. rfc-42/
  9. rfc-44/
  10. rfc-45/
  11. rfc-46/
  12. rfc-47/
  13. rfc-49/
  14. rfc-50/
  15. rfc-51/
  16. rfc-53/
  17. rfc-55/
  18. rfc-56/
  19. rfc-57/
  20. rfc-60/
  21. README.md
  22. template.md
rfc/README.md

RFCs

The RFC process is documented on our site. Please familiarize yourself with it, before working a new RFC.

Status can be one of these values.

StatusMeaning
UNDER REVIEWRFC has been proposed and community is actively debating the design/proposal.
IN PROGRESSThe initial phase of implementation is underway.
ONGOINGSome or most work has landed; community continues to improve or build follow on phases.
ABANDONEDThe proposal was not implemented, due to various reasons.
COMPLETEDAll work is deemed complete.

The list of all RFCs can be found here.

Older RFC content is still here.

RFC NumberTitleStatus
1CSV Source Support for Delta StreamerCOMPLETED
2ORC Storage in HudiONGOING
3Timeline Service with Incremental File System View SyncingCOMPLETED
4Faster Hive incremental pull queriesCOMPLETED
5HUI (Hudi WebUI)ABANDONED
6Add indexing support to the log fileABANDONED
7Point in time Time-Travel queries on Hudi tableCOMPLETED
8Record level indexing mechanisms for Hudi datasetsONGOING
9Hudi Dataset Snapshot ExporterCOMPLETED
10Restructuring and auto-generation of docsCOMPLETED
11Refactor of the configuration framework of hudi projectABANDONED
12Efficient Migration of Large Parquet Tables to Apache HudiCOMPLETED
13Integrate Hudi with FlinkCOMPLETED
14JDBC incremental pullerCOMPLETED
15HUDI File Listing ImprovementsCOMPLETED
16Abstraction for HoodieInputFormat and RecordReaderCOMPLETED
17Abstract common meta sync module support multiple meta serviceCOMPLETED
18Insert Overwrite APICOMPLETED
19Clustering data for freshness and query performanceCOMPLETED
20handle failed recordsIN PROGRESS
21Allow HoodieRecordKey to be VirtualCOMPLETED
22Snapshot Isolation using Optimistic Concurrency Control for multi-writersCOMPLETED
23Hudi Observability metrics collectionABANDONED
24Hoodie Flink Writer ProposalCOMPLETED
25Spark SQL Extension For HudiCOMPLETED
26Optimization For Hudi Table QueryONGOING
27Data skipping index to improve query performanceONGOING
28Support Z-order curveCOMPLETED
29Hash IndexONGOING
30Batch operationUNDER REVIEW
31Hive integration ImprovementONGOING
32Kafka Connect Sink for HudiONGOING
33Hudi supports more comprehensive Schema EvolutionONGOING
34Hudi BigQuery IntegrationCOMPLETED
35Make Flink MOR table writing streaming friendlyUNDER REVIEW
36HUDI Metastore ServerIN PROGRESS
37Hudi Metadata based Bloom IndexONGOING
38Spark Datasource V2 IntegrationIN PROGRESS
39Incremental source for DebeziumONGOING
40Hudi Connector for TrinoIN PROGRESS
41Hudi Snowflake IntegrationUNDER REVIEW
42Consistent Hashing IndexIN PROGRESS
43Compaction / Clustering ServiceUNDER REVIEW
44Hudi Connector for PrestoONGOING
45Asynchronous Metadata IndexingONGOING
46Optimizing Record Payload HandlingIN PROGRESS
47Add Call Produce Command for Spark SQLONGOING
48LogCompaction for MOR tablesUNDER REVIEW
49Support sync with DataHubONGOING
50Improve Timeline ServerIN PROGRESS
51Change Data CaptureUNDER REVIEW
52Introduce Secondary Index to Improve HUDI Query PerformanceUNDER REVIEW
53Use Lock-Free Message Queue Improving Hoodie Writing EfficiencyIN PROGRESS
54New Table APIs and Streamline Hudi ConfigsUNDER REVIEW
55Improve Hive/Meta sync class design and hierarchiesONGOING
56Early Conflict Detection For Multi-WriterUNDER REVIEW
57DeltaStreamer Protobuf SupportUNDER REVIEW
58Integrate column stats index with all query enginesUNDER REVIEW
59Multiple event_time Fields Latest Verification in a Single TableUNDER REVIEW
60Federated Storage LayerUNDER REVIEW
61Snapshot view managementUNDER REVIEW
62Diagnostic ReporterUNDER REVIEW
63Index on Function and Logical PartitioningUNDER REVIEW
64New Hudi Table Spec API for Query IntegrationsUNDER REVIEW