Time partition divides data according to time, and a time partition is used to save all data within a certain time range. The time partition number is represented by a natural number. Number 0 means January 1, 1970, it will increase by one every partition_interval seconds. Time partition number's calculation formula is timestamp / partition_interval. The main configuration items are as follows:
| Name | enable_partition |
|---|---|
| Description | Whether enable time partition for data, if disabled, all data belongs to partition 0 (It's not recommend to open this function. If open, please calculate appropriate concurrent_writing_time_partition and wal_buffer_size) |
| Type | Bool |
| Default | false |
| Effective | Only allowed to be modified in first start up |
| Name | time_partition_interval_for_storage |
|---|---|
| Description | Time range for dividing storage group, time series data will be divided into groups by this time range |
| Type | Int64 |
| Default | 86400 |
| Effective | Only allowed to be modified in first start up |
Enable time partition and set partition_interval to 86400 (one day), then the data distribution is shown as the following figure:
Insert one datapoint with timestamp 0, calculate 0/86400 = 0, then this datapoint will be stored in TsFile under folder 0
Insert one datapoint with timestamp 1609459200010, calculate 1609459200010/86400 = 18628, then this datapoint will be stored in TsFile under folder 18628
When enabling time partition, it is better to enable timed flush memtable, configuration params are detailed in Config manual for timed flush.
enable_timed_flush_unseq_memtable: Whether to enable timed flush unsequence memtable, enabled by default.
enable_timed_flush_seq_memtable: Whether to enable timed flush sequence memtable, disabled by default. It should be enabled when time partition is enabled, so inactive time partition's memtable can be flushed regularly.