seaweedfs/weed/mq/broker
Chris Lu dc784bf217
merge current message queue code changes (#6201)
* listing files to convert to parquet

* write parquet files

* save logs into parquet files

* pass by value

* compact logs into parquet format

* can skip existing files

* refactor

* refactor

* fix compilation

* when no partition found

* refactor

* add untested parquet file read

* rename package

* refactor

* rename files

* remove unused

* add merged log read func

* parquet wants to know the file size

* rewind by time

* pass in stop ts

* add stop ts

* adjust log

* minor

* adjust log

* skip .parquet files when reading message logs

* skip non message files

* Update subscriber_record.go

* send messages

* skip message data with only ts

* skip non log files

* update parquet-go package

* ensure a valid record type

* add new field to a record type

* Update read_parquet_to_log.go

* fix parquet file name generation

* separating reading parquet and logs

* add key field

* add skipped logs

* use in memory cache

* refactor

* refactor

* refactor

* refactor, and change compact log

* refactor

* rename

* refactor

* fix format

* prefix v to version directory
2024-11-04 12:08:25 -08:00
..
broker_connect.go adjust errors 2024-05-16 11:02:48 -07:00
broker_grpc_admin.go subscriber find broker leader first 2024-02-05 23:14:25 -08:00
broker_grpc_assign.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
broker_grpc_balance.go rename 2024-05-21 10:02:07 -07:00
broker_grpc_configure.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
broker_grpc_lookup.go rename 2024-05-21 10:02:07 -07:00
broker_grpc_pub_balancer.go rename 2024-05-21 10:02:07 -07:00
broker_grpc_pub_follow.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
broker_grpc_pub.go adds locking 2024-08-11 13:06:01 -07:00
broker_grpc_sub_coordinator.go balance subscribers 2024-05-27 17:30:16 -07:00
broker_grpc_sub_follow.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
broker_grpc_sub.go remove per-message debug logs 2024-05-30 09:49:08 -07:00
broker_grpc_topic_partition_control.go Merge accumulated changes related to message queue (#5098) 2023-12-11 12:05:54 -08:00
broker_server.go sort imports 2024-06-14 11:44:42 -07:00
broker_topic_conf_read_write.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
broker_topic_partition_read_write.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
broker_write.go Added tls for http clients (#5766) 2024-07-16 23:14:09 -07:00