393 Commits

Author	SHA1	Message	Date
Chris Lu	672868b460	always create .vif file	2019-12-28 21:52:06 -08:00
Chris Lu	b6f7033478	go fmt	2019-12-28 21:37:29 -08:00
Chris Lu	9134092a8d	endure creating .vif files	2019-12-28 21:36:15 -08:00
Chris Lu	0cc8347a3a	go fmt	2019-12-28 21:13:10 -08:00
Chris Lu	37b64a50b4	ec: generate and copy .vif file	2019-12-28 12:44:59 -08:00
Chris Lu	c06f7eb48a	load volume info from .vif file, use superblock as a backup	2019-12-28 12:28:58 -08:00
Chris Lu	f4a74e03d1	refactoring: separating .vif from tier file loading	2019-12-28 11:35:27 -08:00
Chris Lu	2000284435	rename volume tier info to volume info	2019-12-28 11:21:49 -08:00
Chris Lu	e8b357fd53	rename from .tier to .vif	2019-12-28 11:17:39 -08:00
Chris Lu	48d28d3eb2	tier: support remote file attributes and remember the file extension	2019-12-25 21:37:24 -08:00
Chris Lu	1346437d71	Merge pull request #1171 from stlpmo-jn/redundant_type_conversion ... remove the redundant type conversion	2019-12-25 17:02:05 -08:00
Chris Lu	35393b4a02	cleanly destroy remote files	2019-12-25 16:17:58 -08:00
Chris Lu	eecad6062a	go fmt	2019-12-25 09:56:42 -08:00
Chris Lu	d960b3474a	tier storage: support downloading the remote dat files	2019-12-25 09:53:13 -08:00
stlpmo	f3de4b6c18	remove the redundant type conversion	2019-12-25 10:13:45 +08:00
Chris Lu	9ff72f616a	go fmt	2019-12-24 14:56:16 -08:00
Chris Lu	efd2f50ede	compaction changed to .idx based deletion	2019-12-24 14:55:50 -08:00
Chris Lu	d8b39fe92a	testing	2019-12-24 11:29:26 -08:00
Chris Lu	f42b5bd0f5	rename .sdb to .sdx	2019-12-24 10:19:12 -08:00
Chris Lu	abffe857a1	change btree map to in memory level db	2019-12-24 10:18:56 -08:00
Chris Lu	72a561ab7c	refactoring	2019-12-24 08:13:01 -08:00
Chris Lu	409a3fe41f	Merge pull request #1168 from stlpmo-jn/optimize_DeleteCollectionFromDiskLocation ... decouple the volume.Destroy() from the operation of unmountVolume()	2019-12-24 07:08:04 -08:00
stlpmo	38e4b79125	decouple the volume.Destroy() from the operation of unmountVolume()	2019-12-24 17:20:34 +08:00
stlpmo	f300c35266	resolve issue : when the host disk full, the volume server will core dump	2019-12-24 16:36:15 +08:00
Chris Lu	a18f62bbe7	only copy required shards	2019-12-23 18:06:13 -08:00
Chris Lu	8a2d529759	go fmt	2019-12-23 12:48:53 -08:00
Chris Lu	09ca936c78	shell: add ec.decode command	2019-12-23 12:48:20 -08:00
Chris Lu	ab966d7192	refactoring variable name	2019-12-19 00:44:46 -08:00
Chris Lu	f61de28c69	volume: add deletion capability for previously readonly volumes	2019-12-19 00:42:46 -08:00
Chris Lu	deb03ecfa3	remove duplicated checking ... already checked in store.go	2019-12-18 23:59:53 -08:00
Chris Lu	ef3ae3cd41	clean up sorted index file	2019-12-18 20:59:15 -08:00
Chris Lu	39810a9951	tiered volume is read only	2019-12-18 01:26:22 -08:00
Chris Lu	58f88e530c	volume: use sorted index map for readonly volumes	2019-12-18 01:21:21 -08:00
Chris Lu	356bd1b629	adjust text	2019-12-10 22:09:29 -08:00
Chris Lu	10bd3c6b4b	refactoring	2019-12-08 19:44:16 -08:00
Chris Lu	2b8e20f122	remove unused functions	2019-12-08 18:33:25 -08:00
Chris Lu	f38f90b7ea	cleanly remove .tier volume file	2019-12-06 22:19:47 -08:00
Chris Lu	6827cabfbb	volume: dataFileAccessLock change to RW Lock	2019-12-06 06:59:57 -08:00
Chris Lu	e426bd541e	grow volumes on volume servers with slots freed by cloud storage	2019-12-03 21:36:42 -08:00
Chris Lu	7ae8b1cc86	show volume info in volume.list in weed shell	2019-12-02 23:38:56 -08:00
Chris Lu	1becbce657	display remote volumes on volume server ui page	2019-12-02 23:23:54 -08:00
Chris Lu	70648d35ad	go fmt	2019-12-02 20:49:58 -08:00
Chris Lu	6383b45bd0	add lock variable	2019-12-02 20:49:50 -08:00
Chris Lu	caae543a9f	fix test	2019-12-02 15:54:24 -08:00
Chris Lu	ec8de250e2	tiered storage: can copy to s3, read from s3 ... master not aware tiered volume yet, file assigning is not working yet	2019-12-02 15:08:31 -08:00
Chris Lu	0da7b894cc	pass backend config from master to volume servers	2019-11-29 01:05:09 -08:00
Chris Lu	61bc1d6ffd	tweaking	2019-11-28 18:47:51 -08:00
Chris Lu	f60154f330	master load backend storage config from master.toml	2019-11-28 18:33:18 -08:00
Chris Lu	ee2072dff9	volume: avoid inifinite loop reading ec volume info if error happens	2019-11-27 23:07:53 -08:00
Chris Lu	0f9ba84274	s3	2019-11-27 03:09:45 -08:00