47 Commits

Author	SHA1	Message	Date
chrislu	56ce040ab6	log errors	2024-03-15 21:05:40 -07:00
chrislu	6f615c62ae	Merge branch 'master' into mq-subscribe	2024-03-12 09:19:06 -07:00
chrislu	604091a480	use stopChan to close previous filer peer meta subscription instances	2024-03-12 09:18:54 -07:00
chrislu	fa59a5d67e	read from disk if not in memory	2024-01-15 00:20:12 -08:00
chrislu	3fd659df2a	add distributed lock manager	2023-06-25 00:58:21 -07:00
chrislu	81fdf3651b	grpc connection to filer add sw-client-id header	2023-01-20 01:48:12 -08:00
chrislu	7f49c59c14	cluster.ps add filer meta sync progress	2023-01-10 00:51:25 -08:00
Konstantin Lebedev	803ca3c958	avoid data race on doSubscribeToOneFiler/ma.filer.UniqueFilerEpoch (#3566) ... https://github.com/seaweedfs/seaweedfs/issues/3565	2022-09-01 09:01:47 -07:00
chrislu	eaeb141b09	move proto package	2022-08-17 12:05:07 -07:00
Chris Lu	b59bc607bf	Merge pull request #3338 from kmlebedev/issues/3083 ... rollback over onPeerUpdate implementation of automatic clean-up of failed servers in favor of synchronous ping	2022-08-01 08:23:10 -07:00
Konstantin Lebedev	a98f6d66a3	rollback over onPeerupdate implementation of automatic clean-up of failed servers in favor of synchronous ping	2022-08-01 12:51:41 +05:00
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	64f3d6fb6e	metadata subscription uses client epoch	2022-07-23 10:50:28 -07:00
Konstantin Lebedev	b6471ecd75	err msg with duplicated local subscription detected move to log level 1 ... https://github.com/chrislusf/seaweedfs/issues/3320	2022-07-20 18:40:50 +05:00
Konstantin Lebedev	11e393dbe7	err msg with duplicated local subscription detected move to log level 1 ... https://github.com/chrislusf/seaweedfs/issues/3320	2022-07-20 00:45:13 +05:00
chrislu	aca20cd9f4	more logging related to filer metadata subscription	2022-07-15 00:42:13 -07:00
chrislu	fa61074513	add clientId logging	2022-07-14 12:27:34 -07:00
chrislu	860c207c94	typo	2022-07-12 02:56:19 -07:00
石昌林	2b5b37231b	Make sure that onChangeEvent is called successfully before updating lastTsNs	2022-06-29 23:57:07 +08:00
石昌林	e17e6ed542	Avoid synchronizing from scratch due to err	2022-06-29 23:31:04 +08:00
chrislu	6adc42147f	fresh filer store bootstrap from the oldest peer	2022-05-30 21:27:48 -07:00
chrislu	9219664505	reset sync offset if peer filer resets ... fix https://github.com/chrislusf/seaweedfs/issues/3089	2022-05-29 13:11:24 -07:00
Konstantin Lebedev	834210a9dc	avoid connect to the old filler address ... https://github.com/chrislusf/seaweedfs/issues/2545	2022-03-10 15:24:45 +05:00
chrislu	4a311c7f5e	dedup local metadata subscribers ... fix https://github.com/chrislusf/seaweedfs/discussions/2542	2022-01-23 16:14:22 -08:00
chrislu	34742be029	remove duplicated metadata subscription in filer ... https://github.com/chrislusf/seaweedfs/issues/2545	2021-12-30 01:51:52 -08:00
chrislu	9f9ef1340c	use streaming mode for long poll grpc calls ... streaming mode would create separate grpc connections for each call. this is to ensure the long poll connections are properly closed.	2021-12-26 00:15:03 -08:00
Chris Lu	4729a57cc0	use constants	2021-11-08 17:47:56 -08:00
Chris Lu	e0fc2898e9	auto updated filer peer list	2021-11-06 14:23:35 -07:00
Chris Lu	9887610b54	log tsNs should be processing time	2021-09-26 11:54:13 -07:00
Chris Lu	e5fc35ed0c	change server address from string to a type	2021-09-12 22:47:52 -07:00
Chris Lu	cc7714fdbe	logging changes to debug	2021-06-27 05:54:16 -07:00
Chris Lu	2d0a0733ec	filer: bootstrap from peer filer ... fix https://github.com/chrislusf/seaweedfs/issues/1861	2021-05-22 03:17:02 -07:00
Chris Lu	5be83dd4a9	add comments	2021-03-09 14:13:48 -08:00
Chris Lu	442e092995	filer watch "/etc" folder for configuration changes	2020-11-14 14:26:08 -08:00
Chris Lu	b61d33f251	expose only store wrapper to meta changes	2020-09-22 16:27:36 -07:00
Chris Lu	10f9081526	filer: adjust meta data events to received timestamp ... if a client is already connected and start from t0. A message recieved at t+1 but with timestamp t-1 may not be processed by the client. This commit changes to the event received time, so the replication can be ordered.	2020-09-15 01:18:33 -07:00
Chris Lu	446e476a11	go fmt	2020-09-12 04:08:03 -07:00
Chris Lu	daf0a449f7	properly cancel context for streaming grpc	2020-09-09 12:07:15 -07:00
Chris Lu	d8af6f62df	adjust logging	2020-09-06 12:10:40 -07:00
Chris Lu	07f32feed0	print sync progress	2020-09-06 00:50:51 -07:00
Chris Lu	0af6252b2d	fix compilation	2020-09-06 00:50:38 -07:00
Chris Lu	ac494ff5e8	Update meta_aggregator.go	2020-09-06 00:29:16 -07:00
Chris Lu	c9f8f25ba5	read peer filer from start	2020-09-06 00:12:41 -07:00
Chris Lu	8acd714600	apply meta changes only if store is different	2020-09-05 23:25:03 -07:00
Chris Lu	d741ed66db	check whether shares the same filer store	2020-09-05 23:02:52 -07:00
Chris Lu	bba90ff3c8	read filer signature	2020-09-05 22:52:15 -07:00
Chris Lu	eb7929a971	rename filer2 to filer	2020-09-01 00:21:19 -07:00