138 Commits

Author	SHA1	Message	Date
Chris Lu	d1a4e19a3f	volume: copy file also copies modification time ... to ensure ttl can work well	2021-09-01 02:42:57 -07:00
Chris Lu	05a648bb96	refactor: separating out remote.proto	2021-08-26 15:18:34 -07:00
Chris Lu	713c035a6e	shell: remote.cache remote.uncache	2021-08-09 14:35:18 -07:00
Chris Lu	270770d7d7	refactor	2021-08-07 14:18:53 -07:00
Chris Lu	9df7d16791	read <- remote_storage	2021-07-31 22:39:38 -07:00
Chris Lu	b465095db1	shell: add volume.check.disk to fix inconsistency for replicated volumes ... fix https://github.com/chrislusf/seaweedfs/issues/1923	2021-03-22 00:03:16 -07:00
Chris Lu	770393a48c	volume: add capability to change disk type when moving a volume	2021-02-09 23:58:08 -08:00
Chris Lu	2e8dba571b	adjust volume server UI	2020-12-14 00:51:57 -08:00
Chris Lu	94525aa0fd	allocate volume by disk type	2020-12-13 23:08:21 -08:00
Chris Lu	2251a8e472	minor	2020-11-12 00:38:58 -08:00
Konstantin Lebedev	1eec5c8d5d	gen pb	2020-11-12 04:10:06 +05:00
Chris Lu	c9202c4b3d	add storage backend to GetMasterConfigurationResponse	2020-09-16 01:12:22 -07:00
Chris Lu	200fe5c83e	go fmt	2020-09-13 21:26:30 -07:00
Chris Lu	5d6753fb98	shell: add volumeServer.leave command	2020-09-13 21:25:51 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
James Hartig	3ccfa4c6ad	Added VolumeMarkWritable and VolumeStatus grpc methods ... This is necessary for copy to mark as read-only and then restore the original state afterwards.	2020-08-19 11:42:56 -04:00
James Hartig	229f11c660	Added VolumeNeedleStatus volume server grpc method ... This is needed for the diffing tool to get the cookie for a needle	2020-07-22 15:02:21 -04:00
Chris Lu	ca3516ac6d	adjust protoc	2020-06-20 08:00:25 -07:00
Chris Lu	1e3e4b3072	add broker connects to filer	2020-05-05 02:05:28 -07:00
Chris Lu	dcc6b6a3ed	go fmt	2020-04-05 00:52:31 -07:00
Chris Lu	50a5018b7f	writing meta logs is working	2020-03-30 01:19:33 -07:00
Chris Lu	dd5b582d05	go fmt	2020-03-26 00:09:01 -07:00
Chris Lu	6d87a0c5f5	batch delete orphan data by file keys	2020-03-25 02:21:15 -07:00
Chris Lu	c4bea45099	S3 API: fix DeleteMultipleObjectsHandler ... fix https://github.com/chrislusf/seaweedfs/issues/1241	2020-03-20 14:17:31 -07:00
Chris Lu	bec6ec7db6	go fmt	2020-03-17 10:01:55 -07:00
Chris Lu	c3cb6fa1d7	volume: compaction can cause readonly volumes ... address https://github.com/chrislusf/seaweedfs/issues/1233	2020-03-17 09:43:57 -07:00
Chris Lu	2e3f6ad3a9	filer: remember content is gzipped or not	2020-03-08 21:39:33 -07:00
Chris Lu	1ae83c2938	go fmt	2020-03-07 06:12:57 -08:00
Chris Lu	13e215ee5c	filer: option to encrypt data on volume server	2020-03-06 00:49:47 -08:00
Chris Lu	410bce3925	go fmt	2020-03-01 22:39:08 -08:00
Chris Lu	e96f85ed8a	make pb files	2020-02-23 18:06:34 -08:00
LazyDBA247-Anyvision	ec8619176a	volume server protobuf: add precentFree & percentUsage to the DiskStatus	2020-02-23 23:24:24 +02:00
Chris Lu	f55f49970f	move volume server stats to grpc	2020-02-21 21:45:03 -08:00
Chris Lu	9b6296e77a	volume: add grpc file read operation ... This is added more for performance benchmarking.	2020-02-14 00:37:32 -08:00
Chris Lu	40ae533fa3	shell: add volume.configure.replication to change replication for a volume ... fix https://github.com/chrislusf/seaweedfs/issues/1192	2020-02-02 15:37:23 -08:00
Chris Lu	37b64a50b4	ec: generate and copy .vif file	2019-12-28 12:44:59 -08:00
Chris Lu	c06f7eb48a	load volume info from .vif file, use superblock as a backup	2019-12-28 12:28:58 -08:00
Chris Lu	2000284435	rename volume tier info to volume info	2019-12-28 11:21:49 -08:00
Chris Lu	b3c83f9404	fix spelling	2019-12-28 11:16:10 -08:00
Chris Lu	48d28d3eb2	tier: support remote file attributes and remember the file extension	2019-12-25 21:37:24 -08:00
Chris Lu	d960b3474a	tier storage: support downloading the remote dat files	2019-12-25 09:53:13 -08:00
Chris Lu	09ca936c78	shell: add ec.decode command	2019-12-23 12:48:20 -08:00
Chris Lu	ec8de250e2	tiered storage: can copy to s3, read from s3 ... master not aware tiered volume yet, file assigning is not working yet	2019-12-02 15:08:31 -08:00
Chris Lu	0da7b894cc	pass backend config from master to volume servers	2019-11-29 01:05:09 -08:00
Chris Lu	0f9ba84274	s3	2019-11-27 03:09:45 -08:00
Chris Lu	471902cd51	change parameter name	2019-11-10 12:05:45 -08:00
Chris Lu	faec9076a4	adjust parameter names	2019-10-21 22:57:01 -07:00
joeslay	d53aee179b	Merge pull request #10 from chrislusf/master ... merge seaweed master	2019-10-14 16:03:40 +01:00
Chris Lu	f8d4b7d1c0	support basic json filtering and selection	2019-10-06 22:35:08 -07:00
Chris Lu	cf47f657af	scaffold for volume server query feature	2019-10-06 22:35:08 -07:00
j.laycock	84f2dc3b53	Remove test code	2019-09-05 11:14:02 +01:00
Tom Maxwell	4a878c0006	Changed the InMemory bool to a uint32 so that it can be used to alter how much space to reserve	2019-09-04 15:27:14 +01:00
j.laycock	cbd0a98fa1	Add InMemory to Volume Grow structure	2019-09-03 18:19:02 +01:00
Tom Maxwell	d637d86d22	Changes to try and pass the URL parameters through - in memory flag not working still	2019-09-03 15:41:28 +01:00
Chris Lu	6883f9e322	mark volume readonly before ec encoding	2019-06-26 23:02:22 -07:00
Chris Lu	f88a8bda7b	ec deletion works	2019-06-21 01:14:10 -07:00
Chris Lu	4cea8aefd0	add grpc VolumeEcBlobDelete	2019-06-20 00:17:11 -07:00
Chris Lu	7e80b2b882	fix multiple bugs	2019-06-03 02:26:31 -07:00
Chris Lu	b4b407e403	add grpc ec shard read	2019-05-27 11:59:03 -07:00
Chris Lu	db94a41f9e	mount/unmount ec shards	2019-05-25 23:23:19 -07:00
Chris Lu	41e8ae61f8	generate, balance, delete copied shards, delete old volume	2019-05-25 14:02:06 -07:00
Chris Lu	fbbc74abb4	adds VolumeEcGenerateSlices, VolumeEcCopy	2019-05-20 00:53:17 -07:00
Chris Lu	698dea779c	refactoring	2019-05-19 21:37:49 -07:00
Chris Lu	2ffe98443b	refactoring	2019-04-20 12:05:28 -07:00
Chris Lu	6fc1f53018	shell: add command volume.move	2019-04-20 11:35:23 -07:00
Chris Lu	3b3651dea3	volume: atomic copying file, adds version and stopOffset	2019-04-19 12:29:49 -07:00
Chris Lu	ac2727853f	fix needle map entry size	2019-04-19 00:39:34 -07:00
Chris Lu	fa176fe80f	volume tailing chunks large files	2019-04-18 19:22:13 -07:00
Chris Lu	3dce1016cb	add volume tailer	2019-04-18 11:05:02 -07:00
Chris Lu	b09e8dbb37	add VolumeStreamFollow, but not used yet	2019-04-18 00:18:29 -07:00
Chris Lu	13ad5c1966	refactoring	2019-04-17 22:04:49 -07:00
Chris Lu	b3b42bc947	replicate need to include new entry path	2019-04-16 00:44:31 -07:00
Chris Lu	cb2061f86a	Merge pull request #925 from stlpmo-jn/checkUnhealthReplication ... the implement of repair the error replications of the volume	2019-04-10 23:37:12 -07:00
Chris Lu	2f76681d62	refactor: adjust grpc API name	2019-04-10 21:41:17 -07:00
stlpmo-jn	c1a0403da2	repair the error replications of the volume	2019-04-10 19:41:55 +08:00
Chris Lu	19728fe3f6	remove deprecated code	2019-03-25 23:12:14 -07:00
Chris Lu	70815e9124	WIP	2019-03-25 09:16:12 -07:00
Chris Lu	95e0520182	weed volume: add grpc operation to relicate a volume to local	2019-03-23 11:33:34 -07:00
Chris Lu	0c932d1738	add volume delete grpc API ... fix https://github.com/chrislusf/seaweedfs/issues/808	2018-12-29 00:03:30 -08:00
Chris Lu	5333f2984a	streaming updates for large entries or large index file ... fix https://github.com/chrislusf/seaweedfs/issues/801	2018-12-22 11:10:08 -08:00
Chris Lu	46eb77f9bb	move DiskStatus and MemStatus to protobuf	2018-10-15 22:25:28 -07:00
Chris Lu	eec951cad2	migrate volume sync to gRpc	2018-10-15 21:44:41 -07:00
Chris Lu	f8b2d3cacc	move volume mount/unmount on volume server to grpc	2018-10-15 01:48:15 -07:00
Chris Lu	fda771c83f	migrate volume sync status to grpc API on volume server	2018-10-15 01:19:15 -07:00
Chris Lu	b423bb9e2d	migrate assign volume to grpc API on volume server	2018-10-15 00:40:46 -07:00
Chris Lu	8301519fb0	migrate delete collection to grpc API on volume server	2018-10-15 00:03:55 -07:00
Chris Lu	b1daede91b	move volume vacuum to gRpc	2018-10-14 23:12:43 -07:00
Chris Lu	556382ff5f	adding basic grpc to volume server	2018-10-11 01:16:33 -07:00