325 Commits

Author	SHA1	Message	Date
chrislu	ff14dfa0ee	debug	2024-05-30 09:15:50 -07:00
chrislu	b485b9695c	fix passing sub follower offset	2024-05-30 09:15:23 -07:00
chrislu	f7b818483a	fix cases when buffer wraps around	2024-05-30 09:10:30 -07:00
chrislu	9a5cc065b0	fix	2024-05-30 08:29:06 -07:00
chrislu	23a72db1df	stop partitionOffsetChan if closed	2024-05-30 00:27:44 -07:00
chrislu	af19256dbf	skip control messages	2024-05-29 23:34:39 -07:00
chrislu	ad2b878130	fix inflight message tracker	2024-05-29 23:33:37 -07:00
chrislu	f8a22038c5	passing along publisher name	2024-05-29 23:31:48 -07:00
chrislu	f0b9e163a0	avoid nil stopChan	2024-05-29 16:18:02 -07:00
chrislu	a5874954dc	less logs	2024-05-29 16:17:37 -07:00
chrislu	edc87c16f9	balance subscribers ... need to ensure the offsets are persisted	2024-05-27 17:30:16 -07:00
chrislu	6366898af2	add market	2024-05-26 14:35:22 -07:00
chrislu	96b326a304	use type ConsumerGroupInstanceId	2024-05-26 14:09:51 -07:00
chrislu	37d1ee562d	refactor	2024-05-23 09:21:48 -07:00
chrislu	cdeaaf95b4	go fmt	2024-05-23 08:25:53 -07:00
chrislu	d40b350f54	coordinator receives unassignment ack	2024-05-23 08:23:35 -07:00
chrislu	554ae09f82	rename	2024-05-21 10:02:07 -07:00
chrislu	6ef2d010aa	rename file	2024-05-21 09:57:59 -07:00
chrislu	67e6051585	rename Coordinator to SubCoordinator	2024-05-21 09:57:45 -07:00
chrislu	b5099263a4	rename file	2024-05-21 09:56:46 -07:00
chrislu	d5abffa42c	rename Balancer to PubBalancer	2024-05-21 09:56:30 -07:00
chrislu	fa98ecf71e	client side stop partition subscribing if unassigned	2024-05-21 08:42:04 -07:00
chrislu	6634b42981	fix compilation	2024-05-21 08:26:55 -07:00
chrislu	2190d59bc3	refactor ... ToDo 1. handle unassignment on client side 2. get notified of completed unassignment 3. in consumer_group.go, balance and send unassignment	2024-05-21 08:05:56 -07:00
chrislu	3148dec1f6	avoid concurrent processing for the same key	2024-05-20 13:29:37 -07:00
chrislu	a7d30d0705	refactor	2024-05-20 12:32:12 -07:00
chrislu	33aecb7bb4	remove ProcessorConfiguration	2024-05-20 12:28:01 -07:00
chrislu	65dd5ac6fb	fix	2024-05-20 12:27:45 -07:00
chrislu	f13475ac2e	sending keyed offset	2024-05-20 11:09:48 -07:00
chrislu	d45b1d058d	minor	2024-05-20 11:07:54 -07:00
chrislu	3622196881	go fmt	2024-05-20 11:05:18 -07:00
chrislu	5038577f7e	Merge branch 'master' into mq	2024-05-20 11:04:53 -07:00
chrislu	d218fe54fa	go fmt	2024-05-20 11:03:56 -07:00
chrislu	7a4ace5dfb	adjust logs	2024-05-20 09:34:07 -07:00
chrislu	d8ab22012a	track offset	2024-05-20 09:33:37 -07:00
chrislu	2b07a40da5	add InflightMessageTracker	2024-05-20 09:19:39 -07:00
chrislu	a2885512e1	fix	2024-05-19 15:06:33 -07:00
chrislu	8d02712c63	ConcurrentPartitionLimit	2024-05-19 14:55:03 -07:00
chrislu	8ce2cced47	less logs	2024-05-19 14:54:46 -07:00
chrislu	c6db3f31a1	start consuming ASAP	2024-05-19 14:52:38 -07:00
chrislu	c21b32dd20	logs	2024-05-19 11:02:17 -07:00
chrislu	b1871427c3	persist consumer group offset ... 1. use one follower 2. read write consumer group offset	2024-05-19 00:46:12 -07:00
chrislu	8d5bb7420d	rename	2024-05-17 18:21:21 -07:00
chrislu	94742b8ace	add subscribe follower	2024-05-17 18:17:23 -07:00
chrislu	279cb2b85e	consumer acks received messages	2024-05-16 20:28:19 -07:00
chrislu	faffb2973c	adjust errors	2024-05-16 11:02:48 -07:00
chrislu	759a8e50cf	remove logs	2024-05-14 23:22:51 -07:00
chrislu	1f20178ded	subscriber receives partitions and dispatch to processors	2024-05-14 23:22:43 -07:00
chrislu	972e9faaa2	move initial assignment to rebalance logic	2024-05-14 09:09:36 -07:00
chrislu	6e5075e14e	move read write topic config into filer client accessor	2024-05-14 08:50:17 -07:00