69 Commits

Author	SHA1	Message	Date
Chris Lu	5160eb08f7	shell: optionally read filer address from master	2021-11-02 23:38:45 -07:00
Chris Lu	2baed2e1e9	avoid possible metadata subscription data loss ... Previous implementation append filer logs into one file. So one file is not always sorted, which can lead to miss reading some entries, especially when different filers have different write throughput.	2021-09-25 01:18:44 -07:00
Chris Lu	e5fc35ed0c	change server address from string to a type	2021-09-12 22:47:52 -07:00
Chris Lu	6923af7280	refactoring	2021-09-06 16:20:49 -07:00
Chris Lu	cc7714fdbe	logging changes to debug	2021-06-27 05:54:16 -07:00
Chris Lu	8f8738867f	add retry to assign volume ... fix https://github.com/chrislusf/seaweedfs/issues/2056	2021-05-07 07:29:26 -07:00
Chris Lu	990fa69bfe	add back AdjustedUrl() related code	2021-01-28 14:36:29 -08:00
Chris Lu	00707ec00f	mount: outsideContainerClusterMode proxy through filer ... Running mount outside of the cluster would not need to expose all the volume servers to outside of the cluster. The chunk read and write will go through the filer.	2021-01-24 19:01:58 -08:00
Chris Lu	6ca10725b8	Revert "mount: when outside cluster network, use filer as proxy to access volume servers" ... This reverts commit 096e088d7b.	2021-01-24 03:15:19 -08:00
Chris Lu	096e088d7b	mount: when outside cluster network, use filer as proxy to access volume servers	2021-01-24 01:41:38 -08:00
Chris Lu	394513f598	filer: ensure seamless meta data updates	2021-01-11 02:08:55 -08:00
Chris Lu	723ae11db4	refactoring in order to adjust volume server url later	2020-10-11 20:15:10 -07:00
Chris Lu	daf0a449f7	properly cancel context for streaming grpc	2020-09-09 12:07:15 -07:00
Chris Lu	387ab6796f	filer: cross cluster synchronization	2020-09-09 11:21:23 -07:00
Chris Lu	eb7929a971	rename filer2 to filer	2020-09-01 00:21:19 -07:00
Chris Lu	ef75ce8a34	use UTC for all time related folders	2020-08-29 21:01:14 -07:00
Chris Lu	b69cb74c03	read meta logs by timestamp ... pass in event ts when moving logs meta aggregator reads in memory logs only	2020-08-29 17:37:19 -07:00
Chris Lu	ca658a97c5	add signatures to messages to avoid double processing	2020-08-28 23:48:48 -07:00
Chris Lu	55e40b08fc	refactoring	2020-07-05 15:43:06 -07:00
Chris Lu	31e23e9783	filer: support active<=>active filer replication	2020-06-30 22:53:57 -07:00
Chris Lu	45a9d852d3	go fmt	2020-06-05 15:27:10 -07:00
Chris Lu	d3925d086c	add delete channel	2020-05-17 17:42:42 -07:00
Chris Lu	081ee6fe34	reduc logs	2020-05-17 17:38:31 -07:00
Chris Lu	bff09fb74f	fix looping	2020-05-17 17:38:21 -07:00
Chris Lu	f5684839a2	add DeleteTopic	2020-05-17 17:34:10 -07:00
Chris Lu	3a57aef7a9	sync subscribe()	2020-05-17 17:33:53 -07:00
Chris Lu	95ca9dd8a2	subscribe support cancel	2020-05-17 11:10:45 -07:00
Chris Lu	f11233cd49	simplify disconnected stream detection	2020-05-17 08:57:47 -07:00
Chris Lu	85b53ac510	detect disconnected subscribers	2020-05-16 18:53:54 -07:00
Chris Lu	b0de01ff3b	able to detect disconnected subscribers	2020-05-16 08:57:29 -07:00
Chris Lu	e02a8c67da	revert to one subscriber one thread	2020-05-15 21:38:42 -07:00
Chris Lu	ca4017dd87	rename	2020-05-12 22:55:55 -07:00
Chris Lu	25257acd51	rename	2020-05-12 21:26:49 -07:00
Chris Lu	a7959c1c48	multiple subscriber with same subscriberId shares the topic manager ... rename topicControl to topicCursor	2020-05-12 21:26:02 -07:00
Chris Lu	2f243f5b0b	refactor	2020-05-12 08:48:00 -07:00
Chris Lu	d5a8297a1c	able to connect publisher	2020-05-10 23:45:48 -07:00
Chris Lu	39e72fb23c	go fmt	2020-05-10 03:50:30 -07:00
Chris Lu	6bf3eb69cb	async chan write read, no write for closed chan	2020-05-10 03:48:35 -07:00
Chris Lu	d693e77418	add pub sub md5	2020-05-09 00:43:53 -07:00
Chris Lu	07d7abe428	add deleteTopic, refactoring	2020-05-09 00:31:34 -07:00
Chris Lu	dfccc3c263	able to read chan and write chan	2020-05-08 02:47:22 -07:00
Chris Lu	1e3e4b3072	add broker connects to filer	2020-05-05 02:05:28 -07:00
Chris Lu	871efa4fc1	refactoring ... some previous chunk etag was using md5, which should be wrong.	2020-04-30 17:20:47 -07:00
Chris Lu	ea809a45ab	add cipher key	2020-04-30 03:05:43 -07:00
Chris Lu	f9b6178b8f	log messages	2020-04-30 03:05:34 -07:00
Chris Lu	8c73410a51	subscribe from a timestamp	2020-04-30 02:19:51 -07:00
Chris Lu	9e72e9e4b8	able to subscribe any topic from any point of time	2020-04-29 17:40:08 -07:00
Chris Lu	ed3cf811f5	refactoring	2020-04-29 13:26:02 -07:00
Chris Lu	8ed490164e	refactoring	2020-04-28 02:05:44 -07:00
Chris Lu	66effaed9e	fix compilation	2020-04-28 02:05:32 -07:00