43 Commits

Author	SHA1	Message	Date
chrislu	bc888226fc	erasure coding: tracking encoded/decoded volumes ... If an EC shard is created but not spread to other servers, the masterclient would think this shard is not located here.	2022-04-05 19:03:02 -07:00
chrislu	f18803424a	volume.balance: add delay during tight loop ... fix https://github.com/chrislusf/seaweedfs/issues/2637	2022-02-08 00:53:55 -08:00
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls ... streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	2021-12-26 00:15:03 -08:00
chrislu	a2d3f89c7b	add lock messages	2021-12-10 13:24:38 -08:00
Chris Lu	00ae965d8d	randomize a bit for ec shards distribution	2021-11-04 09:23:40 -07:00
Chris Lu	794375ca0a	adjust help message since both fullPercent and quietFor are needed.	2021-11-01 17:22:47 -07:00
Chris Lu	119d5908dd	shell: do not need to lock to see volume -h	2021-09-13 22:13:34 -07:00
Chris Lu	6cd1ce8b74	erasure coding: add cleanup step if anything goes wrong	2021-09-13 01:55:49 -07:00
Chris Lu	e5fc35ed0c	change server address from string to a type	2021-09-12 22:47:52 -07:00
Chris Lu	0f7d4556d8	shell: volume.tier.move makes up changes if volume move failed	2021-08-13 03:09:28 -07:00
Chris Lu	76c48ffe27	optional parallel copy ec shards ... fix https://github.com/chrislusf/seaweedfs/issues/2048	2021-05-06 01:53:35 -07:00
Chris Lu	1b1c018165	adjust text	2021-02-28 19:02:43 -08:00
Chris Lu	1c233ad986	refactoring	2021-02-22 00:28:42 -08:00
Chris Lu	f8446b42ab	this can compile now!!!	2021-02-16 02:47:02 -08:00
Chris Lu	536202e4e0	minor	2020-11-28 02:16:06 -08:00
Chris Lu	ae1994cbc1	erasure coding: fix cases where there are no .ecj files	2020-06-18 09:52:35 -07:00
Chris Lu	75179544c3	logging	2020-05-17 20:20:21 -07:00
Chris Lu	73564e6a01	master: add cluster wide lock/unlock operation in weed shell ... fix https://github.com/chrislusf/seaweedfs/issues/1286	2020-04-23 13:37:31 -07:00
Chris Lu	97ab8a1976	remove ctx if possible	2020-02-25 22:23:59 -08:00
Chris Lu	892e726eb9	avoid reusing context object ... fix https://github.com/chrislusf/seaweedfs/issues/1182	2020-02-25 21:50:12 -08:00
Chris Lu	72a64a5cf8	use the same context object in order to retry	2020-01-26 14:42:11 -08:00
Chris Lu	3ebeae0c0b	ec encode distribute ec data and parity shards evenly	2019-12-24 16:52:21 -08:00
Chris Lu	dda5c6d3cb	fmt	2019-12-22 04:31:36 -08:00
Chris Lu	5f6b360eb7	adjust error message	2019-11-24 23:13:40 -08:00
Chris Lu	8afd8d35b3	master: followers can also lookup and redirect ... improve scalability	2019-07-28 03:58:13 -07:00
Chris Lu	a3d1296ed9	go fmt	2019-06-27 12:18:59 -07:00
Chris Lu	6883f9e322	mark volume readonly before ec encoding	2019-06-26 23:02:22 -07:00
Chris Lu	6bc3dee5b3	refactoring	2019-06-22 10:56:54 -07:00
Chris Lu	f9d8bd51ad	ec shard balancing	2019-06-10 21:32:56 -07:00
Chris Lu	ede876cfdb	periodic scripts exeuction from leader master	2019-06-05 01:30:24 -07:00
Chris Lu	b9e138713c	ec.encode: add -fullPercent option	2019-06-05 00:13:13 -07:00
Chris Lu	d85b41b904	fix ec.encode not finding the local ec shards	2019-06-03 10:38:21 -07:00
Chris Lu	7e80b2b882	fix multiple bugs	2019-06-03 02:26:31 -07:00
Chris Lu	ba18314aab	ec shard delete also check ec volumes, in addition to volumes	2019-06-01 01:41:22 -07:00
Chris Lu	f919d0235c	ec encode volumes quiet for a period of time	2019-05-31 23:41:17 -07:00
Chris Lu	a72cef3c42	encode by collection	2019-05-31 15:48:40 -07:00
Chris Lu	866197eee3	print out the ec balancing plan	2019-05-30 01:38:59 -07:00
Chris Lu	3f9ecee40f	working with reading remote intervals	2019-05-28 21:29:07 -07:00
Chris Lu	b4b407e403	add grpc ec shard read	2019-05-27 11:59:03 -07:00
Chris Lu	db94a41f9e	mount/unmount ec shards	2019-05-25 23:23:19 -07:00
Chris Lu	41e8ae61f8	generate, balance, delete copied shards, delete old volume	2019-05-25 14:02:06 -07:00
Chris Lu	f0e6574d5e	allocate ec shards to volume servers	2019-05-25 02:02:44 -07:00
Chris Lu	228850d588	shard id starts from zero	2019-05-24 11:52:23 -07:00