chrislu
|
49428a303b
|
add batch index for each memory buffer
|
2024-01-08 00:03:08 -08:00 |
|
chrislu
|
d0d24f1e40
|
rename functions
|
2024-01-05 17:10:43 -08:00 |
|
chrislu
|
aa5b6a8187
|
adjust logs
|
2024-01-05 15:35:32 -08:00 |
|
chrislu
|
496fc8fbbf
|
refactor
|
2024-01-05 15:35:19 -08:00 |
|
chrislu
|
e8611ed85d
|
subscribe with partition offset
|
2024-01-05 15:24:14 -08:00 |
|
chrislu
|
531f854af2
|
rename functions
|
2024-01-05 15:16:53 -08:00 |
|
chrislu
|
f8787a9761
|
rename functions
|
2024-01-05 15:16:41 -08:00 |
|
chrislu
|
ddd0fde094
|
rename functions
|
2024-01-05 15:16:01 -08:00 |
|
chrislu
|
ee41dbb7fc
|
rename functions
|
2024-01-05 15:14:25 -08:00 |
|
chrislu
|
47a4963d7a
|
subscription start from specified timestamp
|
2024-01-03 15:57:36 -08:00 |
|
chrislu
|
35869b5c80
|
subscriber can be notified of the assignment change when topic is just configured
Next: Subscriber needs to read by the timestamp offset.
|
2024-01-03 13:30:30 -08:00 |
|
chrislu
|
efb695fd93
|
lookup existing topic partitions
|
2024-01-02 17:29:35 -08:00 |
|
chrislu
|
8b4cd50aac
|
log errors
|
2024-01-01 19:09:17 -08:00 |
|
chrislu
|
32bc8d6a38
|
adjust wait time
|
2023-12-31 17:42:44 -08:00 |
|
chrislu
|
458ddbf919
|
clean up dead code
|
2023-12-31 13:25:33 -08:00 |
|
chrislu
|
2845230329
|
passing broker into the assignments
|
2023-12-28 21:13:49 -08:00 |
|
chrislu
|
093fdc1621
|
subscriber can get assignments
|
2023-12-28 20:35:15 -08:00 |
|
chrislu
|
c950a40aad
|
subscriber keep connected to the balancer
|
2023-12-28 11:56:37 -08:00 |
|
chrislu
|
e0727071c8
|
go fmt
|
2023-12-22 11:33:50 -08:00 |
|
chrislu
|
034db049a0
|
comment fix
|
2023-12-22 11:33:00 -08:00 |
|
chrislu
|
61b05fad95
|
fix test
|
2023-12-11 20:57:29 -08:00 |
|
Chris Lu
|
580940bf82
|
Merge accumulated changes related to message queue (#5098)
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* balance partitions on brokers
* prepare topic partition first and then publish, move partition
* purge unused APIs
* clean up
* adjust logs
* add BalanceTopics() grpc API
* configure topic
* configure topic command
* refactor
* repair missing partitions
* sequence of operations to ensure ordering
* proto to close publishers and consumers
* rename file
* topic partition versioned by unixTimeNs
* create local topic partition
* close publishers
* randomize the client name
* wait until no publishers
* logs
* close stop publisher channel
* send last ack
* comments
* comment
* comments
* support list of brokers
* add cli options
* Update .gitignore
* logs
* return io.eof directly
* refactor
* optionally create topic
* refactoring
* detect consumer disconnection
* sub client wait for more messages
* subscribe by time stamp
* rename
* rename to sub_balancer
* rename
* adjust comments
* rename
* fix compilation
* rename
* rename
* SubscriberToSubCoordinator
* sticky rebalance
* go fmt
* add tests
* tracking topic=>broker
* merge
* comment
|
2023-12-11 12:05:54 -08:00 |
|
chrislu
|
17710e1ecb
|
adjust logs
|
2023-11-15 18:11:35 -08:00 |
|
chrislu
|
de0b969b36
|
Revert "rename"
This reverts commit 35b5264ab7.
|
2023-10-12 20:28:11 -07:00 |
|
chrislu
|
35b5264ab7
|
rename
|
2023-10-11 21:44:56 -07:00 |
|
chrislu
|
bf13f3ced7
|
add subscriber coordinator
|
2023-10-02 01:02:27 -07:00 |
|
chrislu
|
734178093e
|
refactor TopicPartition struct
|
2023-10-02 01:01:45 -07:00 |
|
chrislu
|
2a578b9033
|
refactor
|
2023-10-01 11:59:19 -07:00 |
|
chrislu
|
ebd6f96d35
|
adjust mq.proto
|
2023-09-30 21:47:57 -07:00 |
|
chrislu
|
02cb799481
|
add a test framework for grpc
|
2023-09-30 21:36:58 -07:00 |
|
chrislu
|
c4e6545197
|
fix compilation
|
2023-09-30 21:26:09 -07:00 |
|
chrislu
|
597ab1e4bf
|
add design for mq balancer
|
2023-09-30 13:19:05 -07:00 |
|
chrislu
|
9d589b48e6
|
rename function
|
2023-09-26 15:17:33 -07:00 |
|
chrislu
|
81e57bd45e
|
fix test
|
2023-09-25 08:20:03 -07:00 |
|
chrislu
|
23f334dd13
|
comment
|
2023-09-24 23:36:43 -07:00 |
|
chrislu
|
c7e05e4e71
|
ensure latest stats are reported
|
2023-09-24 23:34:31 -07:00 |
|
chrislu
|
dff2ce5d2f
|
read existing broker stats
|
2023-09-24 23:10:33 -07:00 |
|
chrislu
|
1492bf7552
|
fix listing topics
|
2023-09-24 23:05:41 -07:00 |
|
chrislu
|
3cf9b8d621
|
create topic and report topic
|
2023-09-24 22:00:43 -07:00 |
|
chrislu
|
b3f94feede
|
do create topic
|
2023-09-24 22:00:43 -07:00 |
|
chrislu
|
d74348048a
|
implement create topic
|
2023-09-24 22:00:43 -07:00 |
|
chrislu
|
0361c321b4
|
add CreateTopic API
|
2023-09-24 22:00:43 -07:00 |
|
chrislu
|
411bdda08d
|
fix compilation
|
2023-09-19 16:22:41 -07:00 |
|
chrislu
|
b18112ae10
|
fix compilation bugs during merge
|
2023-09-19 14:08:17 -07:00 |
|
chrislu
|
6c6655de9d
|
wip
|
2023-09-19 14:03:42 -07:00 |
|
chrislu
|
27af11f1e8
|
Revert "Revert "Merge branch 'master' into sub""
This reverts commit 0bb97709d4.
|
2023-09-18 18:47:34 -07:00 |
|
chrislu
|
0bb97709d4
|
Revert "Merge branch 'master' into sub"
This reverts commit 4d414f54a2, reversing
changes made to 4827425146.
|
2023-09-18 16:13:20 -07:00 |
|
chrislu
|
4d414f54a2
|
Merge branch 'master' into sub
|
2023-09-18 16:04:59 -07:00 |
|
chrislu
|
340aea9b34
|
add broker leader
|
2023-09-18 09:01:14 -07:00 |
|
chrislu
|
4e17d399a6
|
refactor
|
2023-09-17 00:04:20 -07:00 |
|