47 Commits

Author	SHA1	Message	Date
chrislu	ccdd9cd8de	refactor	2024-04-02 16:25:43 -07:00
chrislu	f07875e8e1	send flush message to follower before shutting down logBuffer	2024-04-01 16:01:26 -07:00
chrislu	03f18e43df	clean up logs	2024-03-21 23:30:49 -07:00
chrislu	26e24db721	adjust log level	2024-03-21 23:27:19 -07:00
chrislu	f8957b84c1	rename to LastTsNs	2024-03-16 10:52:47 -07:00
chrislu	529fa8c4c8	go fmt	2024-03-16 10:51:47 -07:00
chrislu	059df3957d	rename to lastFlushDataTime	2024-03-16 10:51:16 -07:00
chrislu	6f75a0af55	ask follower to follow	2024-03-10 14:34:28 -07:00
chrislu	28f8f33d6a	include key in LogEntry	2024-03-07 10:53:30 -08:00
chrislu	34f2b600ac	each log function adds a "done" return parameter	2024-03-07 10:50:09 -08:00
chrislu	1b4484bf0a	go fmt	2024-02-29 09:38:52 -08:00
chrislu	1877ce5126	rename	2024-01-15 21:31:21 -08:00
chrislu	fa59a5d67e	read from disk if not in memory	2024-01-15 00:20:12 -08:00
chrislu	188f471a24	logging	2024-01-11 07:55:26 -08:00
chrislu	d51efddf5c	flush to disk ... Need to do: read from disk	2024-01-08 23:27:02 -08:00
chrislu	49428a303b	add batch index for each memory buffer	2024-01-08 00:03:08 -08:00
chrislu	1206313952	add logs on flush	2024-01-05 15:35:42 -08:00
chrislu	add16fb1a1	logs	2024-01-05 15:16:22 -08:00
chrislu	3e9c32a3f0	refactoring to use atomic bool ... fix compilation	2023-08-20 12:13:06 -07:00
Konstantin Lebedev	ee38ab8581	avoid data race of LogBuffer isStopping (#3859)	2022-10-16 11:28:56 -07:00
chrislu	eaeb141b09	move proto package	2022-08-17 12:05:07 -07:00
chrislu	26dbc6c905	move to https://github.com/seaweedfs/seaweedfs	2022-07-29 00:17:28 -07:00
chrislu	d310711de0	avoid possible deadlock: move metadata log flush channel out of lock scope	2022-04-03 21:53:30 -07:00
Chris Lu	3833dac3f7	continue to read from memory if there is no flush	2021-10-17 13:53:04 -07:00
Chris Lu	4ed2994555	use tsMemory to determine whether read from disk or memory ... remove lastFlushTime	2021-10-04 16:02:56 -07:00
Chris Lu	1e3fdf366f	go fmt	2021-10-01 12:10:24 -07:00
Chris Lu	603ea2db73	avoid looping forever if there are no more metadata updates	2021-09-26 11:55:27 -07:00
Chris Lu	9887610b54	log tsNs should be processing time	2021-09-26 11:54:13 -07:00
Chris Lu	7359193e97	go fmt	2021-07-21 14:38:12 -07:00
Chris Lu	2420c60fc4	log reading adds delay between retries	2021-07-01 14:01:25 -07:00
Chris Lu	c764596f96	filer: slow metadata topic read may lose some change events ... fix https://github.com/chrislusf/seaweedfs/issues/2117	2021-06-27 05:54:16 -07:00
Chris Lu	cc7714fdbe	logging changes to debug	2021-06-27 05:54:16 -07:00
Chris Lu	394513f598	filer: ensure seamless meta data updates	2021-01-11 02:08:55 -08:00
Chris Lu	b69cb74c03	read meta logs by timestamp ... pass in event ts when moving logs meta aggregator reads in memory logs only	2020-08-29 17:37:19 -07:00
Chris Lu	0be6863c87	rename	2020-08-26 22:40:15 -07:00
Chris Lu	224103e13b	aggregated logs has empty flushFn	2020-07-11 09:12:03 -07:00
Chris Lu	4b7fa31468	ensure montonically increasing tsNs	2020-05-11 01:53:54 -07:00
Chris Lu	6bf3eb69cb	async chan write read, no write for closed chan	2020-05-10 03:48:35 -07:00
Chris Lu	f9b6178b8f	log messages	2020-04-30 03:05:34 -07:00
Chris Lu	5a0986dca0	reset on getting the buffer	2020-04-29 02:41:01 -07:00
Chris Lu	5eb83dfbd3	add memory buffer size limit	2020-04-20 17:43:50 -07:00
Chris Lu	258fba8a0f	continue for reading from sealed memory buffer	2020-04-20 17:28:18 -07:00
Chris Lu	4bf959edf0	message broker: read also from sealed memory buffer	2020-04-20 17:26:38 -07:00
Chris Lu	ce3cb25cfb	working for in memory single log buffer	2020-04-19 23:37:50 -07:00
Chris Lu	f5a748d33c	refactoring	2020-04-16 02:55:09 -07:00
Chris Lu	7764e0465c	refactoring	2020-04-12 21:00:55 -07:00
Chris Lu	ed54682598	refactoring	2020-04-11 12:43:17 -07:00