| Changes for HDFS-1073 branch |
| |
| This change list will be merged into the trunk CHANGES.txt when the HDFS-1073 |
| branch is merged. |
| ---------------------------- |
| |
| HDFS-1521. Persist transaction ID on disk between NN restarts. |
| (Ivan Kelly and Todd Lipcon via todd) |
| HDFS-1538. Refactor more startup and image loading code out of FSImage. |
| (todd) |
| HDFS-1729. Add code to detect valid length of an edits file. (todd) |
| HDFS-1793. Add code to inspect a storage directory with txid-based filenames |
| (todd) |
| HDFS-1794. Add code to list which edit logs are available on a remote NN (todd) |
| HDFS-1858. Add state management variables to FSEditLog (Ivan Kelly and Todd |
| Lipcon via todd) |
| HDFS-1859. Add some convenience functions to iterate over edit log streams |
| (Ivan Kelly and Todd Lipcon via todd) |
| HDFS-1894. Add constants for LAYOUT_VERSIONs in edits log branch (todd) |
| HDFS-1892. Fix EditLogFileInputStream.getValidLength to be aware of OP_INVALID |
| filler (todd) |
| HDFS-1799. Refactor log rolling and filename management out of FSEditLog |
| (Ivan Kelly and Todd Lipcon via todd) |
| HDFS-1801. Remove use of timestamps to identify checkpoints and logs (todd) |
| HDFS-1930. TestDFSUpgrade failing in HDFS-1073 branch (todd) |
| HDFS-1800. Extend image checksumming to function with multiple fsimage files |
| per directory. (todd) |
| HDFS-1725. Set storage directories only at FSImage construction (Ivan Kelly |
| via todd) |
| HDFS-1926. Remove references to StorageDirectory from JournalManager interface |
| (Ivan Kelly via todd) |
| HDFS-1893. Change edit logs and images to be named based on txid (todd) |
| HDFS-1985. Clean up image transfer servlet (todd) |
| HDFS-1984. Enable multiple secondary namenodes to run simultaneously (todd) |
| HDFS-1987. Re-enable TestCheckpoint.testSecondaryImageDownload which was not |
| running previously. (todd) |
| HDFS-1993. TestCheckpoint needs to clean up between cases (todd) |
| HDFS-1992. Remove vestiges of NNStorageListener. (todd) |
| HDFS-1991. Some refactoring of Secondary NameNode to be able to share more |
| code with the BackupNode or CheckpointNode. (todd) |
| HDFS-1994. Fix race conditions when running two rapidly checkpointing |
| Secondary NameNodes. (todd) |
| HDFS-2001. Remove use of previous.checkpoint and lastcheckpoint.tmp directories |
| (todd) |
| HDFS-2015. Remove checkpointTxId from VERSION file. (todd) |
| HDFS-2016. Add infrastructure to remove or archive old and unneeded storage |
| files within the name directories. (todd) |
| HDFS-2047. Improve TestNamespace and TestEditLog in HDFS-1073 branch. (todd) |
| HDFS-2048. Add upgrade tests and fix upgrade from 0.22 with corrupt image. |
| (todd) |
| HDFS-2027. Image inspector should return finalized logs before unfinalized |
| logs. (todd) |
| HDFS-2074. Determine edit log validity by truly reading and validating |
| transactions. (todd) |
| HDFS-2085. Finalize in-progress edit logs at startup. (todd) |
| HDFS-2026. SecondaryNameNode should properly handle the case where the |
| NameNode is reformatted. (todd) |
| HDFS-2077. Address checkpoint upload when one of the storage dirs is failed |
| (todd) |
| HDFS-2078. NameNode should not clear directory when restoring removed storage. |
| (todd) |
| HDFS-2088. Move edits log archiving logic into FSEditLog/JournalManager (todd) |
| HDFS-2093. Handle case where an entirely empty log is left during NN crash |
| (todd) |
| HDFS-2102. Zero-pad edits filename to make them lexically sortable. (Ivan |
| Kelly via todd) |
| HDFS-2010. Fix NameNode to exit if all edit streams become inaccessible. (atm |
| via todd) |
| HDFS-2123. Checkpoint interval should be based on txn count, not size. (todd) |
| HDFS-1979. Fix backupnode for new edits/image layout. (todd) |
| HDFS-2101. Fix remaining unit tests for new storage filenames. (todd) |
| HDFS-2133. Address remaining TODOs and pre-merge cleanup on HDFS-1073 branch. |
| (todd) |
| HDFS-1780. Reduce need to rewrite FSImage on startup. (todd) |
| HDFS-2104. Add a flag to the 2NN to format its checkpoint dirs on startup. |
| (todd) |
| HDFS-2135. Fix regression of HDFS-1955 in HDFS-1073 branch. (todd) |
| HDFS-2160. Fix CreateEditsLog test tool in HDFS-1073 branch. (todd) |
| HDFS-2168. Reenable TestEditLog.testFailedOpen and fix exposed bug. (todd) |
| HDFS-2169. Clean up TestCheckpoint and remove TODOs (todd) |
| HDFS-2170. Address remaining TODOs in HDFS-1073 branch. (todd) |
| HDFS-2172. Address findbugs and javadoc warnings in HDFS-1073 branch. (todd) |
