coffeecloudgit
6cbce110d5
Update volume_grpc_erasure_coding.go ( #6073 )
2024-09-27 07:02:30 -07:00
Neo
aa61824442
master:fix empty target in Build() ( #6069 )
2024-09-27 00:45:18 -07:00
Max Denushev
f1e700ce2f
Fix/copy before delete replication ( #6064 )
...
* fix(shell): volume.fix.replication misplaced volumes unsatisfying replication factor
* fix(shell): simplify replication check
* fix(shell): add test for satisfyReplicaCurrentLocation
2024-09-26 08:34:13 -07:00
steve.wei
ae8c6d95a6
fix: Prevent potential metadata change events from being lost. ( #6066 )
2024-09-26 08:31:57 -07:00
LHHDZ
4dc33cc143
fix unclaimed spaces calculation when volumePreallocate is enabled ( #6063 )
...
the calculation of `unclaimedSpaces` only needs to subtract `unusedSpace` when `preallocate` is not enabled.
Signed-off-by: LHHDZ <shichanglin5@qq.com>
2024-09-24 23:04:18 -07:00
Max Denushev
d056c0ddf2
fix(volume): don't persist RO state in specific cases ( #6058 )
...
* fix(volume): don't persist RO state in specific cases
* fix(volume): writable always persist
2024-09-24 16:15:54 -07:00
zemul
028ebb1d0d
Feat:merge small chunk ( #6049 )
...
* fix:mount deadlock
* feat: merge small chunk
* adjust MergeChunkMinCount
* fix
---------
Co-authored-by: zemul <zhouzemiao@ihuman.com>
2024-09-23 08:51:03 -07:00
chrislu
4ec6eab004
fix max volume count auto setting
...
related to https://github.com/seaweedfs/seaweedfs/issues/6041#issuecomment-2360448182
2024-09-19 09:13:08 -07:00
dsd
a3572999bb
Vol check disk bug ( #6044 )
...
* fix volume.check.disk
* ensure multiple replica sync
* add comment
---------
Co-authored-by: 邓书东 <shudong_deng@hhnb2024010108.intsig.com>
2024-09-19 08:32:22 -07:00
Konstantin Lebedev
6d4f5c94ac
[volume] remove truncate idx file if size not healthy ( #6043 )
2024-09-19 01:04:08 -07:00
chrislu
50e22864cf
refactor
2024-09-17 23:10:41 -07:00
chrislu
99ae99e3b9
fix nil filer conf
...
fix https://github.com/seaweedfs/seaweedfs/issues/6034
2024-09-17 11:07:29 -07:00
Konstantin Lebedev
2b13d2c083
[filer] fix return 204 for DELETE on entry not found ( #6023 )
...
fix return 204 for DELETE on entry not found
2024-09-16 23:11:03 -07:00
Guang Jiong Lou
6c986e9d70
improve worm support ( #5983 )
...
* improve worm support
Signed-off-by: lou <alex1988@outlook.com>
* worm mode in filer
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* move to fs configure
Signed-off-by: lou <alex1988@outlook.com>
* remove flag
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* support worm hardlink
Signed-off-by: lou <alex1988@outlook.com>
* update after review
Signed-off-by: lou <alex1988@outlook.com>
* typo
Signed-off-by: lou <alex1988@outlook.com>
* sync filer conf
Signed-off-by: lou <alex1988@outlook.com>
---------
Signed-off-by: lou <alex1988@outlook.com>
2024-09-16 21:02:21 -07:00
Guang Jiong Lou
367e7638d7
fix invalid file read ( #6024 )
2024-09-16 08:45:50 -07:00
Eugeniy E. Mikhailov
0da9e40abb
Feature: compress before encryption ( #6013 )
2024-09-15 08:47:53 -07:00
Bruce
5428229347
fix file read crash ( #6021 )
2024-09-14 08:33:35 -07:00
zouyixiong
881c9a009e
[master] master missing start LoopPushingMetric routine fixed. ( #6018 )
2024-09-13 20:01:34 -07:00
Aleksey Kosov
7340c62c47
changing FindEntry error handling in cassandra store ( #6015 )
2024-09-13 06:53:04 -07:00
chrislu
a9c9e1bcb3
refactor
2024-09-12 22:45:30 -07:00
chrislu
6063a889ed
3.73
2024-09-12 13:11:55 -07:00
Eugeniy E. Mikhailov
dab0bb8097
Feature limit caching to prescribed number of bytes per file ( #6009 )
...
* feature: we can check if a fileId is already in the cache
We using this to protect cache from adding the same needle to
the cache over and over.
* fuse mount: Do not start dowloader if needle is already in the cache
* added maxFilePartSizeInCache property to ChunkCache
If file very large only first maxFilePartSizeInCache bytes
are going to be put to the cache (subject to the needle size
constrains).
* feature: for large files put in cache no more than prescribed number of bytes
Before this patch only the first needle of a large file was intended for
caching. This patch uses maximum prescribed amount of bytes to be put in
cache. This allows to bypass default 2MB maximum for a file part stored
in the cache.
* added dummy mock methods to satisfy interfaces of ChunkCache
2024-09-11 21:09:20 -07:00
dsd
151f2ff7a9
prevent dead loop for followers of master node ( #6007 )
...
* prevent dead loop for followers of master node
* fix comments
---------
Co-authored-by: levi <344887649@foxmail.com>
2024-09-11 10:24:52 -07:00
dsd
3b840c20e3
change math/rand => math/rand/v2 in volume_layout.go where is a perfo… ( #6006 )
2024-09-11 07:39:40 -07:00
Eugeniy E. Mikhailov
c04edeed68
bug fix in the data received from cache processing ( #6002 )
...
The patch addresses #3745 .
The cache should return the exact amount of data requested by the buffer.
By construction of the cache it is always all requested data range
or we have error happening.
The old use of minsize miscalculate the requested data size,
if non zero offset is requested.
2024-09-10 13:30:18 -07:00
chrislu
d660d5c7d4
increasing default cache size
2024-09-10 10:30:19 -07:00
chrislu
f23015ac5b
weed mount caching
2024-09-10 10:30:05 -07:00
chrislu
93decd1114
remove unused
2024-09-10 10:29:25 -07:00
chrislu
69fcdd0840
adjust logging
2024-09-10 10:28:49 -07:00
Konstantin Lebedev
34bbaa2cdd
[master] process grow request with must grow ( #5999 )
...
process grow request with must grow
2024-09-09 23:45:02 -07:00
Konstantin Lebedev
15965f7c54
[shell] fix volume grow in shell ( #5992 )
...
* fix volume grow in shell
* revert add Async
* check available volume space
* create a VolumeGrowRequest and remove unnecessary fields
2024-09-09 11:42:56 -07:00
chrislu
43d9f68219
more consistent server header for s3 apis
2024-09-09 09:07:58 -07:00
zouyixiong
d8e18a8eb7
bug fixed to filer store elastic deleteEntry ( #5988 )
2024-09-09 02:15:25 -07:00
chrislu
ff3d46637d
better logging for volume growth
2024-09-07 12:38:34 -07:00
chrislu
accba3070a
refactor
2024-09-07 11:54:22 -07:00
Eugeniy E. Mikhailov
d6b0e0ff1c
Remove "Content-Length" header if http.Error is issued ( #5981 )
2024-09-05 17:31:28 -07:00
Eugeniy E. Mikhailov
bc01f09e37
Do CRC check if the buffer contains the full needle data before it is sent ( #5980 )
2024-09-05 17:14:55 -07:00
Bruce
f9e141a412
persist readonly state to volume info ( #5977 )
2024-09-05 07:58:24 -07:00
Bruce
310d41998d
Skip volume data integrity check for volume which has remote file ( #5976 )
2024-09-04 21:25:04 -07:00
Konstantin Lebedev
16984ef07a
[s3] reducing the number of metrics for 403 ( #5961 )
...
reducing the number of metrics
2024-09-04 11:06:54 -07:00
Konstantin Lebedev
67a252ee8a
[master] refactor func ShouldGrowVolumes ( #5884 )
2024-09-04 08:16:44 -07:00
chrislu
eb02946c97
support write once read many
...
fix https://github.com/seaweedfs/seaweedfs/issues/5954
2024-09-04 02:25:07 -07:00
chrislu
18afdb15b6
Revert "weed mount, weed dav add option to force cache"
...
This reverts commit 7367b976b0
2024-09-04 01:38:29 -07:00
chrislu
7367b976b0
weed mount, weed dav add option to force cache
2024-09-04 01:19:14 -07:00
chrislu
66ac82bb8f
default cacheDirWrite to cacheDir
2024-09-04 00:05:58 -07:00
chrislu
8d5a6d7e74
fix for spreading ec shards
2024-09-03 22:30:11 -07:00
chrislu
8e4bffc66b
copy ec shards to disks already having ec volumes
...
fix https://github.com/seaweedfs/seaweedfs/issues/5615
2024-09-03 21:19:10 -07:00
wyang
361e7ebc74
fix volume.move io.EOF ( #5960 )
2024-09-02 06:17:41 -07:00
Eugeniy E. Mikhailov
282867a71e
Show volume server which failed to verify a chunk ( #5958 )
2024-09-01 21:13:22 -07:00
Eugeniy E. Mikhailov
220061573d
update metric for ErrorCRC if it happens during volume readNeedleDataInto ( #5957 )
2024-09-01 20:30:09 -07:00
