mirror/seaweedfs
1
0
Fork 0
mirror of https://github.com/seaweedfs/seaweedfs.git synced 2024-12-24 09:27:54 +08:00
Code Issues Packages Projects Releases Wiki Activity
4f2bdebe49
seaweedfs/weed/filer
History
Eugeniy E. Mikhailov dab0bb8097
Feature limit caching to prescribed number of bytes per file (#6009) 
* feature: we can check if a fileId is already in the cache

We using this to protect cache from adding the same needle to
the cache over and over.

* fuse mount: Do not start dowloader if needle is already in the cache

* added maxFilePartSizeInCache property to ChunkCache

If file very large only first maxFilePartSizeInCache bytes
are going to be put to the cache (subject to the needle size
constrains).

* feature: for large files put in cache no more than prescribed number of bytes

Before this patch only the first needle of a large file was intended for
caching. This patch uses maximum prescribed amount of bytes to be put in
cache. This allows to bypass default 2MB maximum for a file part stored
in the cache.

* added dummy mock methods to satisfy interfaces of ChunkCache
2024-09-11 21:09:20 -07:00
..
abstract_sql check bucket name in sql backend 2024-06-25 08:54:19 -07:00
arangodb refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
cassandra refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
elastic/v7 bug fixed to filer store elastic deleteEntry (#5988) 2024-09-09 02:15:25 -07:00
etcd Move ListDirectoryEntries logic to ListDirectoryPrefixedEntries in etcd meta storage backend (#5416) 2024-03-24 14:08:54 -07:00
hbase refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
leveldb adjust logging 2024-09-10 10:28:49 -07:00
leveldb2 optionally open the leveldb in readonly mode 2024-06-25 21:07:04 -07:00
leveldb3 optionally open the leveldb in readonly mode 2024-06-25 21:07:04 -07:00
mongodb Feature/mongodb security (#5602) 2024-05-18 12:19:10 -07:00
mysql chore: add dsn for connection to mysql (#5060) 2023-12-20 16:20:58 -08:00
mysql2 print only adapted url 2024-03-25 12:50:43 -07:00
postgres print only adapted url 2024-03-25 12:50:43 -07:00
postgres2 print only adapted url 2024-03-25 12:50:43 -07:00
redis upgrade to github.com/redis/go-redis/v9 2024-07-11 00:15:19 -07:00
redis2 upgrade to github.com/redis/go-redis/v9 2024-07-11 00:15:19 -07:00
redis3 fix test 2024-07-11 07:53:02 -07:00
redis_lua upgrade to github.com/redis/go-redis/v9 2024-07-11 00:15:19 -07:00
rocksdb fix: disallow file name too long when writing a file (#4881) 2023-10-12 14:29:55 -07:00
sqlite serialize sqlite operations 2022-10-12 00:03:27 -07:00
store_test move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
tikv Fix: issues #4950 (#4952) 2023-10-25 22:09:39 -07:00
ydb chore(deps): bump github.com/ydb-platform/ydb-go-sdk-auth-environ from 0.2.0 to 0.4.2 (#5621) 2024-05-27 12:36:00 -07:00
configuration.go add notes for full version 2023-01-04 09:52:25 -08:00
entry_codec.go also migrate jsonpb 2022-08-17 12:42:03 -07:00
entry.go refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
filechunk_group_test.go more solid weed mount (#4089) 2023-01-02 23:20:45 -08:00
filechunk_group.go remove unused 2024-09-10 10:29:25 -07:00
filechunk_manifest_test.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
filechunk_manifest.go Added tls for http clients (#5766) 2024-07-16 23:14:09 -07:00
filechunk_section_test.go merge chunks during upload (#4130) 2023-01-12 23:07:36 -08:00
filechunk_section.go Mount concurrent read (#4400) 2023-04-13 22:32:45 -07:00
filechunks2_test.go Revert "Revert "Merge branch 'master' of https://github.com/seaweedfs/seaweedfs"" 2023-09-25 09:35:16 -07:00
filechunks_read_test.go more solid weed mount (#4089) 2023-01-02 23:20:45 -08:00
filechunks_read.go fix when two consecutive chunks with the same modified_ts_ns 2024-02-04 09:22:24 -08:00
filechunks_test.go fix when two consecutive chunks with the same modified_ts_ns 2024-02-04 09:22:24 -08:00
filechunks.go refactor 2023-01-10 00:46:46 -08:00
filer_buckets.go filer: remove replication, collection, disk_type info from entry metadata 2022-06-06 00:39:35 -07:00
filer_conf_test.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
filer_conf.go get, set and add path conf 2024-07-20 11:27:11 -07:00
filer_delete_entry.go conditional delete 2024-08-01 13:00:54 -07:00
filer_deletion.go rename functions 2024-08-01 23:27:23 -07:00
filer_hardlink.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
filer_notify_append.go Added tls for http clients (#5766) 2024-07-16 23:14:09 -07:00
filer_notify_read.go fix heap init 2024-07-11 00:26:18 -07:00
filer_notify_test.go refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
filer_notify.go Squashed commit of the following: 2024-07-11 00:04:24 -07:00
filer_on_meta_event.go refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
filer_rename.go Fix: http rename move dir to subdir (#4432) 2023-04-26 20:54:36 -07:00
filer_search.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
filer.go bootstrap filer from one peer 2024-06-28 14:57:20 -07:00
filerstore_hardlink.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
filerstore_translate_path.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
filerstore_wrapper.go skip checking if it is the root directory 2024-07-07 23:44:36 -07:00
filerstore.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
interval_list_test.go more solid weed mount (#4089) 2023-01-02 23:20:45 -08:00
interval_list.go Mount concurrent read (#4400) 2023-04-13 22:32:45 -07:00
meta_aggregator.go refactor 2024-04-02 16:25:43 -07:00
meta_replay.go ParallelProcessDirectoryStructure 2024-06-28 15:02:46 -07:00
read_remote.go refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
read_write.go refactor filer_pb.Entry and filer.Entry to use GetChunks() 2022-11-15 06:33:36 -08:00
reader_at_test.go Feature limit caching to prescribed number of bytes per file (#6009) 2024-09-11 21:09:20 -07:00
reader_at.go Feature limit caching to prescribed number of bytes per file (#6009) 2024-09-11 21:09:20 -07:00
reader_cache.go Feature limit caching to prescribed number of bytes per file (#6009) 2024-09-11 21:09:20 -07:00
reader_pattern.go Fix a few data races when reading files in mount (#3527) 2022-08-26 16:41:37 -07:00
remote_mapping.go Remote gateway Bug fix (#5100) 2023-12-12 07:46:45 -08:00
remote_storage_test.go move to https://github.com/seaweedfs/seaweedfs 2022-07-29 00:17:28 -07:00
remote_storage.go chore(deps): bump github.com/viant/ptrie from 0.3.1 to 1.0.1 (#5552) 2024-04-29 18:42:31 -07:00
s3iam_conf_test.go s3: fix configuring IAM for the same user 2022-08-30 09:37:52 -07:00
s3iam_conf.go associate Account and Identity by accountId (#3754) 2022-09-28 13:25:59 -07:00
stream.go Added tls for http clients (#5766) 2024-07-16 23:14:09 -07:00
topics.go rename filer2 to filer 2020-09-01 00:21:19 -07:00