Google Git
Sign in
apache / incubator-crail / refs/tags/v1.1
tag7c60075ebc506f46d2edb122c573659553e35cd5
taggerAdrian Schuepbach <asq@apache.org>Tue Dec 04 12:55:10 2018 +0100
object08c75b55f7f97be869049cf80a0da5347e550a3d 
Apache Crail release v1.1
commit08c75b55f7f97be869049cf80a0da5347e550a3d[log] [tgz]
authorAdrian Schuepbach <asq@apache.org>Mon Nov 26 13:46:29 2018 +0100
committerAdrian Schuepbach <asq@apache.org>Mon Nov 26 13:46:29 2018 +0100
tree91cc41fd30dcc8dbe4df8c7f45259b0810106dea
parentf831d45b7f9081a31544c9de02b713e8a110e9c3 [diff]
[maven-release-plugin] prepare release v1.1-rc8
12 files changed
tree: 91cc41fd30dcc8dbe4df8c7f45259b0810106dea
  1. assembly/
  2. bin/
  3. client/
  4. conf/
  5. doc/
  6. docker/
  7. hdfs/
  8. libexec/
  9. licenses/
  10. namenode/
  11. rpc/
  12. rpc-darpc/
  13. rpc-narpc/
  14. storage/
  15. storage-narpc/
  16. storage-nvmf/
  17. storage-rdma/
  18. .gitignore
  19. checkstyle.xml
  20. CREDITS
  21. DISCLAIMER
  22. HISTORY.md
  23. LICENSE
  24. LICENSE-binary
  25. NOTICE
  26. pom.xml
  27. README.md
README.md

license Documentation Status

Apache Crail (incubating)

Apache Crail is a fast multi-tiered distributed storage system designed from ground up for high-performance network and storage hardware. It marks the backbone of the Crail I/O architecture, which is described in more detail on crail.incubator.apache.org. The unique features of Crail include:

  • Zero-copy network access from userspace
  • Integration of multiple storage tiers such DRAM, flash and disaggregated shared storage
  • Ultra-low latencies for both meta data and data operations. For instance: opening, reading and closing a small file residing in the distributed DRAM tier less than 10 microseconds, which is in the same ballpark as some of the fastest RDMA-based key/value stores
  • High-performance sequential read/write operations: For instance: read operations on large files residing in the distributed DRAM tier are typically limited only by the performance of the network
  • Very low CPU consumption: a single core sharing both application and file system client can drive sequential read/write operations at the speed of up to 100Gbps and more
  • Asynchronous API leveraging the asynchronous nature of RDMA-based networking hardware
  • Extensible plugin architecture: new storage tiers tailored to specific hardware can be added easily

Crail is implemented in Java offering a Java API which integrates directly with the Java off-heap memory. Crail is designed for performance critical temporary data within a scope of a rack or two.

Documentation

For information about how to deploy, run, test and program against Crail:

Community

Please join the Crail developer mailing list for discussions and notifications. The list is at:

dev@crail.incubator.apache.org.

Disclaimer

Apache Crail is an effort undergoing incubation at The Apache Software Foundation (ASF), sponsored by the Apache Incubator PMC. Incubation is required of all newly accepted projects until a further review indicates that the infrastructure, communications, and decision making process have stabilized in a manner consistent with other successful ASF projects. While incubation status is not necessarily a reflection of the completeness or stability of the code, it does indicate that the project has yet to be fully endorsed by the ASF.