seaweedfs/go/storage
chrislusf 1b6ab2f6af Add boltdb for volume needle map
boltdb is fairly slow to write, about 6 minutes for recreating index
for 1553934 files. Boltdb loads 1,553,934 x 16 = 24,862,944bytes from
disk, and generate the boltdb as large as 134,217,728 bytes in 6
minutes.

To compare, for leveldb, it recreates index in leveldb as large as
27,188,148 bytes in 8 seconds.
For in memory version, it loads the index in

To test the memory consumption, the leveldb or boltdb index are
created. And the server is restarted. Using the benchmark tool to read
lots of files. There are 7 volumes in benchmark collection, each with
about 1553K files.
For leveldb, the memory starts at 142,884KB, and stays at 179,340KB.
For boltdb, the memory starts at 73,756KB, and stays at 144,564KB.
For in-memory, the memory starts at 368,152KB, and stays at 448,032KB.
2015-03-29 11:04:32 -07:00
..
compact_map_perf_test.go formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
compact_map_test.go add test case for issue 52 2013-10-31 12:55:51 -07:00
compact_map.go follow golint suggestions 2015-03-10 00:20:34 -07:00
compress.go formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
crc.go formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
file_id.go formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
needle_map_boltdb.go Add boltdb for volume needle map 2015-03-29 11:04:32 -07:00
needle_map_leveldb.go Add boltdb for volume needle map 2015-03-29 11:04:32 -07:00
needle_map_memory.go add leveldb support for needle map 2015-03-27 16:34:58 -07:00
needle_map.go Add boltdb for volume needle map 2015-03-29 11:04:32 -07:00
needle_read_write.go follow golint suggestions 2015-03-10 00:20:34 -07:00
needle.go avoid auto unzip tar.gz files 2015-02-25 23:59:44 -08:00
replica_placement_test.go fix bug when reading back the replica settings! 2014-04-13 03:06:15 -07:00
replica_placement.go add TTL support 2014-09-20 12:38:59 -07:00
store_vacuum.go follow golint suggestions 2015-03-10 00:20:34 -07:00
store.go Add boltdb for volume needle map 2015-03-29 11:04:32 -07:00
volume_id.go testing compilation with remove package 2013-02-10 03:49:51 -08:00
volume_info.go Cleanup error printing. 2015-01-13 17:04:41 -08:00
volume_super_block_test.go add TTL support 2014-09-20 12:38:59 -07:00
volume_super_block.go Cleanup error printing. 2015-01-13 17:04:41 -08:00
volume_ttl_test.go Adding unit tests for volume ttl. 2014-09-20 20:51:24 -07:00
volume_ttl.go tweaking ui 2015-03-22 12:50:04 -07:00
volume_vacuum.go Add boltdb for volume needle map 2015-03-29 11:04:32 -07:00
volume_version.go formatting code by: goimports -w=true . 2014-10-26 11:34:55 -07:00
volume.go Add boltdb for volume needle map 2015-03-29 11:04:32 -07:00