44 Commits

Author	SHA1	Message	Date
chrislu	27bb38228b	only broad cast when there are waiting threads	2024-03-16 11:38:27 -07:00
chrislu	34f2b600ac	each log function adds a "done" return parameter	2024-03-07 10:50:09 -08:00
chrislu	fa59a5d67e	read from disk if not in memory	2024-01-15 00:20:12 -08:00
chrislu	49428a303b	add batch index for each memory buffer	2024-01-08 00:03:08 -08:00
chrislu	cbc24c7b24	disconnect from old subscribers	2023-10-13 16:48:14 -07:00
chrislu	b90d92fca9	grpc: watch metadata changes by directory	2022-09-20 09:25:18 -07:00
chrislu	eaeb141b09	move proto package	2022-08-17 12:05:07 -07:00
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	64f3d6fb6e	metadata subscription uses client epoch	2022-07-23 10:50:28 -07:00
chrislu	aca20cd9f4	more logging related to filer metadata subscription	2022-07-15 00:42:13 -07:00
chrislu	fbd8f868a1	filer may have trouble to re-connect ... clientId is used twice: one for local metadata subscription, one for combined metadata subscription.	2022-07-14 12:15:31 -07:00
liubaojiang	4e83e92156	add subscriber clientId if it is the first time	2022-07-08 20:27:25 +08:00
zhihao.qu	42d04c581b	feat(filer.sync): add metricsServer in filer.sync. ... Metrics include: (1) the offset of the filer.sync (2) the last send timestamp of the filer subscription	2022-06-15 11:33:18 +08:00
chrislu	f214dfb1f5	stop when in memory log is done	2022-05-30 15:25:21 -07:00
chrislu	aece35a64f	stop when on disk log is done	2022-05-30 15:20:51 -07:00
chrislu	a2b101a737	subscribe metadata between a range	2022-05-30 15:04:19 -07:00
chrislu	7e25a2d416	reduce busy waiting when reading metadata logs	2022-05-24 00:23:53 -07:00
chrislu	4a311c7f5e	dedup local metadata subscribers ... fix https://github.com/chrislusf/seaweedfs/discussions/2542	2022-01-23 16:14:22 -08:00
chrislu	5c87fcc6d2	add client id for all metadata listening clients	2021-12-30 00:23:57 -08:00
chrislu	2d6fcdf83a	add delay if need to resume from disk	2021-12-09 13:13:05 -08:00
Chris Lu	29fa1b9fdc	add logs	2021-10-17 13:50:34 -07:00
Chris Lu	603ea2db73	avoid looping forever if there are no more metadata updates	2021-09-26 11:55:27 -07:00
Chris Lu	7ce97b59d8	go fmt	2021-09-01 02:45:42 -07:00
Chris Lu	43fd11278e	support follow additional path prefixes	2021-08-31 23:23:08 -07:00
qieqieplus	233103f6b2	sync empty notification with timestamp	2021-07-05 16:01:16 +08:00
Chris Lu	2420c60fc4	log reading adds delay between retries	2021-07-01 14:01:25 -07:00
Chris Lu	067eb15e70	remove debug messages	2021-07-01 01:24:07 -07:00
Chris Lu	215b169562	mount: recursively rename locally	2021-07-01 01:19:31 -07:00
Chris Lu	17477b37d5	sleep before re-reading the messages ... If there are no more metadata changes and the client disconnects, it would go into a busy loop without this fix.	2021-06-27 06:31:04 -07:00
Chris Lu	cc7714fdbe	logging changes to debug	2021-06-27 05:54:16 -07:00
Chris Lu	c2e0a75c1f	adjust logs	2021-06-24 12:46:00 -07:00
Chris Lu	394513f598	filer: ensure seamless meta data updates	2021-01-11 02:08:55 -08:00
Chris Lu	ac22f1dd26	filer subscribe: handle rename subscription	2020-12-07 00:10:49 -08:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	8acd714600	apply meta changes only if store is different	2020-09-05 23:25:03 -07:00
Chris Lu	eb7929a971	rename filer2 to filer	2020-09-01 00:21:19 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
Chris Lu	4f6096c7f0	add reading from persisted logs for local filer store	2020-07-13 22:55:28 -07:00
Chris Lu	1dd2c76532	refactoring	2020-07-12 17:31:24 -07:00
Chris Lu	0b8cc9b626	aggregate multiple filer metadata chagne events	2020-07-05 23:05:02 -07:00
Chris Lu	49929e0869	rename	2020-07-05 15:52:36 -07:00
Chris Lu	70d8a3a1d3	add SubscribeLocalMetadata without checking persisted meta logs	2020-07-05 15:50:07 -07:00
Chris Lu	55e40b08fc	refactoring	2020-07-05 15:43:06 -07:00
Chris Lu	881e0fde2e	rename	2020-07-05 08:55:09 -07:00