70 Commits

Author	SHA1	Message	Date
chrislu	8948fb51e3	Merge branch 'master' into mq-subscribe	2024-04-25 23:42:19 -07:00
M@	abf01a0eb7	Fixes unlocked read from logBuffer.LastTsNs that is racey. (#5536)	2024-04-25 15:46:12 -07:00
chrislu	ccdd9cd8de	refactor	2024-04-02 16:25:43 -07:00
chrislu	f07875e8e1	send flush message to follower before shutting down logBuffer	2024-04-01 16:01:26 -07:00
chrislu	03f18e43df	clean up logs	2024-03-21 23:30:49 -07:00
chrislu	26e24db721	adjust log level	2024-03-21 23:27:19 -07:00
chrislu	5c0fcae039	clean up logs	2024-03-21 23:24:18 -07:00
chrislu	407a52fc93	adjust log level	2024-03-21 23:23:26 -07:00
chrislu	50023fe1cf	adjust log level	2024-03-21 08:07:56 -07:00
chrislu	3c559dc294	fix test2	2024-03-16 23:48:31 -07:00
chrislu	054d0b3487	wait for data	2024-03-16 11:14:14 -07:00
chrislu	f8957b84c1	rename to LastTsNs	2024-03-16 10:52:47 -07:00
chrislu	529fa8c4c8	go fmt	2024-03-16 10:51:47 -07:00
chrislu	059df3957d	rename to lastFlushDataTime	2024-03-16 10:51:16 -07:00
chrislu	6f75a0af55	ask follower to follow	2024-03-10 14:34:28 -07:00
chrislu	28f8f33d6a	include key in LogEntry	2024-03-07 10:53:30 -08:00
chrislu	34f2b600ac	each log function adds a "done" return parameter	2024-03-07 10:50:09 -08:00
chrislu	1b4484bf0a	go fmt	2024-02-29 09:38:52 -08:00
chrislu	1877ce5126	rename	2024-01-15 21:31:21 -08:00
chrislu	fa59a5d67e	read from disk if not in memory	2024-01-15 00:20:12 -08:00
chrislu	188f471a24	logging	2024-01-11 07:55:26 -08:00
chrislu	d51efddf5c	flush to disk ... Need to do: read from disk	2024-01-08 23:27:02 -08:00
chrislu	49428a303b	add batch index for each memory buffer	2024-01-08 00:03:08 -08:00
chrislu	1206313952	add logs on flush	2024-01-05 15:35:42 -08:00
chrislu	add16fb1a1	logs	2024-01-05 15:16:22 -08:00
chrislu	c563386675	rename parameters	2023-11-09 08:02:39 -08:00
chrislu	16e3f2d528	fix log buffer test	2023-08-20 12:46:15 -07:00
chrislu	3e9c32a3f0	refactoring to use atomic bool ... fix compilation	2023-08-20 12:13:06 -07:00
Konstantin Lebedev	ee38ab8581	avoid data race of LogBuffer isStopping (#3859)	2022-10-16 11:28:56 -07:00
chrislu	eaeb141b09	move proto package	2022-08-17 12:05:07 -07:00
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	21b6b07dd8	renaming	2022-07-28 23:22:06 -07:00
chrislu	968ca95b49	filer.meta.tail: support untilTimeAgo for a range	2022-05-30 16:16:23 -07:00
chrislu	f214dfb1f5	stop when in memory log is done	2022-05-30 15:25:21 -07:00
chrislu	7e25a2d416	reduce busy waiting when reading metadata logs	2022-05-24 00:23:53 -07:00
chrislu	d310711de0	avoid possible deadlock: move metadata log flush channel out of lock scope	2022-04-03 21:53:30 -07:00
Chris Lu	3833dac3f7	continue to read from memory if there is no flush	2021-10-17 13:53:04 -07:00
Chris Lu	4ed2994555	use tsMemory to determine whether read from disk or memory ... remove lastFlushTime	2021-10-04 16:02:56 -07:00
Chris Lu	1e3fdf366f	go fmt	2021-10-01 12:10:24 -07:00
Chris Lu	603ea2db73	avoid looping forever if there are no more metadata updates	2021-09-26 11:55:27 -07:00
Chris Lu	9887610b54	log tsNs should be processing time	2021-09-26 11:54:13 -07:00
Chris Lu	7359193e97	go fmt	2021-07-21 14:38:12 -07:00
Chris Lu	2420c60fc4	log reading adds delay between retries	2021-07-01 14:01:25 -07:00
Chris Lu	c764596f96	filer: slow metadata topic read may lose some change events ... fix https://github.com/chrislusf/seaweedfs/issues/2117	2021-06-27 05:54:16 -07:00
Chris Lu	cc7714fdbe	logging changes to debug	2021-06-27 05:54:16 -07:00
Chris Lu	0ef43a23a7	go fmt	2021-01-12 02:30:12 -08:00
Chris Lu	394513f598	filer: ensure seamless meta data updates	2021-01-11 02:08:55 -08:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	b69cb74c03	read meta logs by timestamp ... pass in event ts when moving logs meta aggregator reads in memory logs only	2020-08-29 17:37:19 -07:00
Chris Lu	0be6863c87	rename	2020-08-26 22:40:15 -07:00