66 Commits

Author	SHA1	Message	Date
bingoohuang	b4e93b639d	remove unnecessary comments	2020-05-29 11:28:08 +08:00
bingoohuang	accb4964b7	util.BytesToHumanReadable	2020-05-29 10:00:07 +08:00
bingoohuang	16fc3fb1a0	fix build error	2020-05-25 20:45:21 +08:00
Chris Lu	e5a0787653	filer: leveldb store add auto recovery, report correct error ... fix https://github.com/chrislusf/seaweedfs/issues/1326	2020-05-22 10:54:42 -07:00
Chris Lu	7764e0465c	refactoring	2020-04-12 21:00:55 -07:00
Chris Lu	d30483d642	re-enable system logs	2020-04-12 14:03:07 -07:00
Chris Lu	2d7d4b1006	add tool to see log entries	2020-04-08 07:18:26 -07:00
Chris Lu	2a2d92d06e	adjust	2020-04-04 15:15:10 -07:00
Chris Lu	d1d9137e8c	add a tool to check disk status	2020-04-04 13:17:34 -07:00
Chris Lu	c0f0fdb3ba	refactoring	2020-03-23 00:01:34 -07:00
Chris Lu	025e586c91	testing vacuum	2020-03-13 15:41:27 -07:00
Chris Lu	1f8fc4b5ed	vacuum benchmarking	2020-03-09 20:45:28 -07:00
Chris Lu	2e3f6ad3a9	filer: remember content is gzipped or not	2020-03-08 21:39:33 -07:00
Chris Lu	9228ff192c	encryption works	2020-03-07 11:08:57 -08:00
Chris Lu	13e215ee5c	filer: option to encrypt data on volume server	2020-03-06 00:49:47 -08:00
Chris Lu	d335f04de6	support env variables to overwrite toml file	2020-01-29 09:09:55 -08:00
Chris Lu	b7bc08cf52	fix compilation	2019-12-28 11:50:42 -08:00
Chris Lu	09ca936c78	shell: add ec.decode command	2019-12-23 12:48:20 -08:00
Chris Lu	f60154f330	master load backend storage config from master.toml	2019-11-28 18:33:18 -08:00
Lei Liu	46755ea1e1	fix master maintenance logic ... Signed-off-by: Lei Liu <lei01.liu@horizon.ai>	2019-11-12 14:46:10 +08:00
Chris Lu	4b5ba4927f	adjust NewDiskFile() paramaters	2019-10-29 22:37:36 -07:00
Chris Lu	19b6a16003	changed from os.file to backend.DataStorageBackend	2019-10-29 00:35:16 -07:00
Chris Lu	fc412e428b	refactor ScanVolumeFileFrom()	2019-10-22 00:50:30 -07:00
Lei Liu	3cc084269c	master api: return http 404 when volumeId not exist ... Signed-off-by: Lei Liu <lei01.liu@horizon.ai>	2019-09-29 14:23:39 +08:00
Ingard Mevåg	f7a0a0e62c	new tool based on see_dat to remove duplicate fids. Duped fids could happen if a volume server was shut down before it could complete vacumming	2019-08-30 11:26:50 +02:00
Chris Lu	94b039d3d9	move	2019-07-21 10:45:25 -07:00
Chris Lu	c5408a4a2d	benchmark leveldb performance	2019-07-02 21:25:18 -07:00
Chris Lu	ede876cfdb	periodic scripts exeuction from leader master	2019-06-05 01:30:24 -07:00
Chris Lu	17ac1290c0	volume: load ec shards during heartbeats to master	2019-05-21 22:41:20 -07:00
Chris Lu	0fe286a6ca	filer: optimization for leveldb, add leveldb2 ... large filer db may see high CPU and disk usage due to background compaction	2019-05-17 17:33:49 -07:00
Chris Lu	ed0b2d62fb	fix typo	2019-04-29 01:21:23 -07:00
Chris Lu	6aad558972	add tool to see meta file generated by "fs.meta.save"	2019-04-29 01:18:24 -07:00
Chris Lu	6fc1f53018	shell: add command volume.move	2019-04-20 11:35:23 -07:00
Chris Lu	ac2727853f	fix needle map entry size	2019-04-19 00:39:34 -07:00
Chris Lu	e5506152c0	refactoring	2019-04-18 21:43:36 -07:00
Chris Lu	33c92b819a	refactoring	2019-04-18 21:17:43 -07:00
Chris Lu	072644969e	refactoring	2019-04-18 20:04:44 -07:00
Chris Lu	fa176fe80f	volume tailing chunks large files	2019-04-18 19:22:13 -07:00
Chris Lu	3dce1016cb	add volume tailer	2019-04-18 11:05:02 -07:00
Chris Lu	b09e8dbb37	add VolumeStreamFollow, but not used yet	2019-04-18 00:18:29 -07:00
Chris Lu	af52fb2316	stress test filer	2019-04-15 21:13:07 -07:00
Chris Lu	26aaccca08	add stress filer test code	2019-04-12 11:13:47 -07:00
Chris Lu	44647a46c0	needle scanner read appendAtNs	2019-03-17 23:28:43 -07:00
Chris Lu	77b9af531d	adding grpc mutual tls	2019-02-18 12:11:52 -08:00
Chris Lu	98a03b38e5	avoid util package depends on security package	2019-02-16 12:23:35 -08:00
Chris Lu	74fb237727	benchmark can work in secure mode	2019-02-15 00:09:19 -08:00
bingoohuang	ab6be025d7	go fmt and fix some typo	2019-01-17 09:17:19 +08:00
bingoohuang	6ddfaf33cb	extract VolumeFileScanner for ScanVolumeFile	2019-01-16 17:48:59 +08:00
Chris Lu	fb1ed0e30d	add tool to printout dat file content	2018-11-22 00:24:50 -08:00
Chris Lu	1fcbed4e90	add delete	2018-11-03 23:14:05 -07:00