310 Commits

Author	SHA1	Message	Date
chrislu	d40b350f54	coordinator receives unassignment ack	2024-05-23 08:23:35 -07:00
chrislu	554ae09f82	rename	2024-05-21 10:02:07 -07:00
chrislu	6ef2d010aa	rename file	2024-05-21 09:57:59 -07:00
chrislu	67e6051585	rename Coordinator to SubCoordinator	2024-05-21 09:57:45 -07:00
chrislu	b5099263a4	rename file	2024-05-21 09:56:46 -07:00
chrislu	d5abffa42c	rename Balancer to PubBalancer	2024-05-21 09:56:30 -07:00
chrislu	fa98ecf71e	client side stop partition subscribing if unassigned	2024-05-21 08:42:04 -07:00
chrislu	6634b42981	fix compilation	2024-05-21 08:26:55 -07:00
chrislu	2190d59bc3	refactor ... ToDo 1. handle unassignment on client side 2. get notified of completed unassignment 3. in consumer_group.go, balance and send unassignment	2024-05-21 08:05:56 -07:00
chrislu	3148dec1f6	avoid concurrent processing for the same key	2024-05-20 13:29:37 -07:00
chrislu	a7d30d0705	refactor	2024-05-20 12:32:12 -07:00
chrislu	33aecb7bb4	remove ProcessorConfiguration	2024-05-20 12:28:01 -07:00
chrislu	65dd5ac6fb	fix	2024-05-20 12:27:45 -07:00
chrislu	f13475ac2e	sending keyed offset	2024-05-20 11:09:48 -07:00
chrislu	d45b1d058d	minor	2024-05-20 11:07:54 -07:00
chrislu	3622196881	go fmt	2024-05-20 11:05:18 -07:00
chrislu	5038577f7e	Merge branch 'master' into mq	2024-05-20 11:04:53 -07:00
chrislu	d218fe54fa	go fmt	2024-05-20 11:03:56 -07:00
chrislu	7a4ace5dfb	adjust logs	2024-05-20 09:34:07 -07:00
chrislu	d8ab22012a	track offset	2024-05-20 09:33:37 -07:00
chrislu	2b07a40da5	add InflightMessageTracker	2024-05-20 09:19:39 -07:00
chrislu	a2885512e1	fix	2024-05-19 15:06:33 -07:00
chrislu	8d02712c63	ConcurrentPartitionLimit	2024-05-19 14:55:03 -07:00
chrislu	8ce2cced47	less logs	2024-05-19 14:54:46 -07:00
chrislu	c6db3f31a1	start consuming ASAP	2024-05-19 14:52:38 -07:00
chrislu	c21b32dd20	logs	2024-05-19 11:02:17 -07:00
chrislu	b1871427c3	persist consumer group offset ... 1. use one follower 2. read write consumer group offset	2024-05-19 00:46:12 -07:00
chrislu	8d5bb7420d	rename	2024-05-17 18:21:21 -07:00
chrislu	94742b8ace	add subscribe follower	2024-05-17 18:17:23 -07:00
chrislu	279cb2b85e	consumer acks received messages	2024-05-16 20:28:19 -07:00
chrislu	faffb2973c	adjust errors	2024-05-16 11:02:48 -07:00
chrislu	759a8e50cf	remove logs	2024-05-14 23:22:51 -07:00
chrislu	1f20178ded	subscriber receives partitions and dispatch to processors	2024-05-14 23:22:43 -07:00
chrislu	972e9faaa2	move initial assignment to rebalance logic	2024-05-14 09:09:36 -07:00
chrislu	6e5075e14e	move read write topic config into filer client accessor	2024-05-14 08:50:17 -07:00
chrislu	ac63f2b5a1	refactor	2024-05-13 22:03:57 -07:00
chrislu	844a1a0192	rename	2024-05-13 19:24:47 -07:00
chrislu	372bd8d71d	consumer instance passing MaxPartitionCount to coordinator	2024-05-13 18:30:10 -07:00
chrislu	2142842f82	refactor	2024-05-13 18:25:38 -07:00
chrislu	8cc5298a08	clean up unused variables	2024-05-10 13:10:45 -07:00
chrislu	fcedf97e94	fix test	2024-05-05 22:19:59 -07:00
chrislu	664b704e30	add delay	2024-05-05 14:17:41 -07:00
chrislu	4e3701df77	reset last error	2024-05-05 14:16:54 -07:00
chrislu	30f8600a24	working	2024-05-03 21:27:06 -07:00
chrislu	7a9b115cc2	rename	2024-05-02 11:14:58 -07:00
chrislu	4a3e8869bb	subscriber can unmarshal the record	2024-05-02 09:56:11 -07:00
chrislu	1c5043baf7	rename	2024-05-02 09:47:29 -07:00
chrislu	f2f4630029	rename field types	2024-05-02 08:59:22 -07:00
chrislu	b8af997e41	consistent with protobuf data types	2024-05-02 08:52:10 -07:00
chrislu	0f35b3a4ea	add example to publish a record	2024-05-02 08:48:51 -07:00