| commit | c0113ce69a80d35b89ba5dda2fd45512bca6b548 | [log] [tgz] |
|---|---|---|
| author | Surinder Singh <sursingh@gmail.com> | Wed Jun 16 18:18:24 2021 -0700 |
| committer | GitHub <noreply@github.com> | Wed Jun 16 18:18:24 2021 -0700 |
| tree | 08d023300753a8a66b10039b4146ae7847a33392 | |
| parent | 16e8ba772bb5cf4c7546fb559bd9d455d4e42625 [diff] |
[STATESTORE] Cleanup local storage for statestore storage container ### Motivation While restoring a storage container, we fetch the checkpoint from the checkpoint store. Currently this checkpoint will never get cleaned up. Every time we restore the storage container on pod, a new checkpoint will get added. Over period of time the disk usage keeps going up and eventually we have to manually delete these stale checkpoints. ### Changes With this change, we will cleanup the local storage for a storage container whenever we close the KVStore. This will ensure that stale checkpoints are not left behind. It is possible that POD may restart before the cleanup can be done. To avoid these, we will also ensure that local storage for the storage container is cleaned up before we restore the storage container. Reviewers: Henry Saputra <hsaputra@apache.org> This closes #2739 from sursingh/storage-cleanup and squashes the following commits: 6bd477691 [Surinder Singh] Clean local storage for storage containers c74683695 [Surinder Singh] Add test case for local storage cleanup
Apache BookKeeper is a scalable, fault tolerant and low latency storage service optimized for append-only workloads.
It is suitable for being used in following scenarios:
Please visit the Documentation from the project website for more information.
For filing bugs, suggesting improvements, or requesting new features, help us out by opening a Github issue or opening an Apache jira.
Subscribe or mail the user@bookkeeper.apache.org list - Ask questions, find answers, and also help other users.
Subscribe or mail the dev@bookkeeper.apache.org list - Join development discussions, propose new ideas and connect with contributors.
Join us on Slack - This is the most immediate way to connect with Apache BookKeeper committers and contributors.
We feel that a welcoming open community is important and welcome contributions.
See Developer Setup to get your local environment setup.
Take a look at our open issues: JIRA Issues Github Issues.
Review our coding style and follow our pull requests to learn about our conventions.
Make your changes according to our contribution guide.