seaweedfs/weed/operation
Chris Lu dc784bf217
merge current message queue code changes (#6201)
* listing files to convert to parquet

* write parquet files

* save logs into parquet files

* pass by value

* compact logs into parquet format

* can skip existing files

* refactor

* refactor

* fix compilation

* when no partition found

* refactor

* add untested parquet file read

* rename package

* refactor

* rename files

* remove unused

* add merged log read func

* parquet wants to know the file size

* rewind by time

* pass in stop ts

* add stop ts

* adjust log

* minor

* adjust log

* skip .parquet files when reading message logs

* skip non message files

* Update subscriber_record.go

* send messages

* skip message data with only ts

* skip non log files

* update parquet-go package

* ensure a valid record type

* add new field to a record type

* Update read_parquet_to_log.go

* fix parquet file name generation

* separating reading parquet and logs

* add key field

* add skipped logs

* use in memory cache

* refactor

* refactor

* refactor

* refactor, and change compact log

* refactor

* rename

* refactor

* fix format

* prefix v to version directory
2024-11-04 12:08:25 -08:00
..
assign_file_id_test.go Added context for the MasterClient's methods to avoid endless loops (#5628) 2024-06-14 11:40:34 -07:00
assign_file_id.go [shell] fix volume grow in shell (#5992) 2024-09-09 11:42:56 -07:00
buffer_pool.go go fmt 2021-04-02 02:22:59 -07:00
chunked_file.go rename functions 2024-08-01 23:27:23 -07:00
data_struts.go cleanup security.Secret 2019-02-09 21:56:32 -08:00
delete_content.go rename functions 2024-08-01 23:27:23 -07:00
grpc_client.go grpc connection to filer add sw-client-id header 2023-01-20 01:48:12 -08:00
lookup_vid_cache_test.go directory structure change to work with glide 2016-06-02 18:09:14 -07:00
lookup_vid_cache.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
lookup.go math/rand => math/rand/v2 2024-08-29 09:52:21 -07:00
needle_parse_test.go Added tls for http clients (#5766) 2024-07-16 23:14:09 -07:00
submit.go merge current message queue code changes (#6201) 2024-11-04 12:08:25 -08:00
sync_volume.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
tail_volume.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
upload_content.go Feature: compress before encryption (#6013) 2024-09-15 08:47:53 -07:00